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FOREWORD 




. Researt:h and development, if properly directed, can be amonc 
the most effective means of dealing viith the needs and problems 
facing vocational educatl-ori. ' The selection of research studies 
and development activities that offer the most leverage on major 
^roblei^s is a 'complex decision requiring many kinds of inforftiation . 
The National Center under its contract with the Bureau of Opcu- 
pationjal 'and Adult Education, U.S. 'Office of Education, is pleased ' 
to offer this report *7hich is intended to assist in -selecting 
national priorities for applied research and development.. Major 
needs of vocational education are identified as are tho'se for, , 
which research and development are most needed. Particular -re- 
search and development need^ are fcited and ' strategies are sug- 
gested . • . . ' j; 

^ The National Center expresses its. appreciation to the marjy 
individuals who contributed . to this study and report. Eleven 
prominent scholars and administrators, whose names appear ini! the 
Table of Contents', are due special- recognition for their insight- 
ful .reports on important research' and development needs in partic- 
ular ar^as. We appreciate, too, the' generous -assistance of the 
distinguished consultants who gave invaluable as^sistance in iden- 
tifying and clarifying research and development n^eds : ^upett N. - ^ 
Evans, Malrvin F. Feldman, Charles L. Law, Gordon I. SWanson, 
Grant Vehn, George Wallrodt, William D. Woolf, and Robert M. - 
Worthington. Kollie B." Thomas, Allen A. Wiant, and VJilliam D. 
V^oolf made valuable contributions in their critical reviews pf 
thfe manuscript prior to final revision. 

Finally, recognition is due to several members^ of the 
National Center staff: Morgan Lewis directed the study and 
prepared this report -with the assistance of Stephen A._^Marcus a" 
and Bruce J. Shylo' under the general direction of Edward J. Morrison 



^ Robert E. Taylor 
Executive Director 
The^National Center for Research 
in Vocational Education 
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, • ■ CIiAPTER 1 

.' " 1 INTRODUCTION" \ ' 

One of the direct ^harges to the National Center for Research 
in Vocational Education under Public Law 94-482 is to "develop 
and. provide .information to facilitate national planning and pro- 
gram development in vocational education". (Sec. 171 (a) {D) ). 
One of the specific tasks under this general charge is to provide 
information on applied research and development priorities in 
vocational education. This report represents the effort of the 
National Center' to. carry out this task. It .is important that the 
nature .of the effort is clearly understoo5'. The task was not to 
set priorities," but, instead, to provide information which will - 
be useful to the U.S. Office of Education in setting national . 
priotities. This distinction was, at times, a diffjicult one to 
maintain. Obviou&ly it was^ impossibie to provide, or even to 
know, all the information that would be usefu^ in setting priori-' 
ties. All that could be provided was the information judged most 
cogent and useful. The infgrmation in this report is thus care- 
fully selectea. . . , - 

'This distihct^ion is stressed so that this' report does not 
raise expectations it canrfot fulfill. This report will not 
describe the research .and development needs of vocational educa- 
tion _ but some of these needs. ^ The manner in which ^hese needs 
^were identified and the kinds of research that micflit be directed 
to tliem are descriibed in detail below. 

Before presenting thi^ description, an overview of the organ- 
ization of the chapter afTd the remainder of the xepoirt' may be 
useful. The report contains three main chapters and an appendix.' 
TJiia first chapter is an 'introduc.tion and presents the nature of. 
the problem to which tl?is study was addressed and the procedures 
followed to examine tHe problem. The problem wa's essentially to 
identify the major needs facing vocational education, to select 
from among those ne,eds the ones most amenable to research and 
development, and to develop strategies appropriate to these ijeeds. 
The 'procodur.es followed consisted of a content analysis of signi- 
ficant documents, verification with a panel of expert consultants, 
and the development of background papers from specialists in the 
need areas selected for additional attention. ^- 

Chapter 2 presents the result's of the content analysis pf th^ 
selected documents. From this analyst's a total of fifteen major 
needs' was identified. The documentation is the same for each of 
the needs. First the legislation relevant to the need is quoted 
directly from Title " II of the Educational Amendments of- 1976. ' 
Pertinent material from other sources is then "summarized . Each of 
the^e sourcesVis cited separately; no attempt is m^de to integrate 



or compare sources. In fact, this' chapter contains no interpre- 
tation or discussion.; it priesents no more than the relevenl. docu- 
mentation. ; * ^ ' ■ 

Chapter 3 presents background p^^pers prepared, by specialists 
in the need areas chosen for additional attention. These papers - 
vai^y cQnsiderably in approach, . depth, and degree "to which they 
specify the kinds of R&D that should.be directe'd to the needs/ 
This variation reflects to some degree Tthe perspectives of the 
consultants^- an attempt was made to ge\^ a mix k^f both researchers 
'and ^practitioners - and the time they could , devote to the task'/ 
^It also reflects, however, the charge ■ that was given to the con-^ 
^ult^ants. They were encouraged - to go beyond the present 'sta±.e of 
the art to^prepare a "think piece" or working - notes instead of a^ 
fully developed paper., The intention was that the time the. con- 
suitants' cbyld devote to these papers should be spent in thinking 
about the needs and the kinds of research that should be directed 
to the chosen areas. Consequently, many of the papers, a;:e not 
as f^ulLy developed 'as they would be if the consultants had been ; 
asked to prepare more finished products. Most do, however, achieve^ 
the primary goal of raising' important research and development 
questions'. 

statement of Purpose 

^ ' • ' ■ .. 

This report is intended to provide information that .will aid 
the U.S. 'office of Education in setting national research and 
development ^iriorities. It i^s' directed at identifying long-term- 
needs of widespread or national significance. Of particular con-- 
cerri are those problems and needs of vocational 'education where 
solutions are impeded by aack of knowledge or adequate tools' and 
for- which research and development are necessaxy and appropriate 
ji-nterventions • By definition,^ such problems and needs dre^not 
amenable to sho^rt-term , easy solutio^ns. Instead, they require 
targeted efforts, necessitating sustained and substantial invest- 
ments of time and other scarce *^resources . Suc-h a commitment 
requires not only that the most pervasivo and significant {practical 
problems and neqds be. carefully selects and documented, but that 
these problems ^nd needs amenable to research and devel-Qpnent 
solutions. Moreover, research and 'development objectives and 
priorities must be widely understood, accepted, and endorsed by' 
a significant majority of .the field to insure tlieir stability 
so thatr, in. time, effective solutions will be pos-sible. 

Thus, the intent and overall strategy of thi^^^s project is to 
identify 'ma jor national needs of vocational aducc\uion that requdro 
research and dGvelopmcnt, and then to identify and explain the 
kinds of re'search and development * recfu ired for each need. Suc^h 
identification and explanation is intended to be of u^^iC'to tbr'e 
Coordinating Committee on Research in Vocational Ixlucation, which 
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is developinq a .plan for establishinq national priorities for 
vocational education research, and to contribute to the coordina- * 
tipn of several member ayencies. It is expected to be' of «jEurthcr 
direct use in- the identi* ication of the "designated*' and "inde- 
pendent"' studies to be conducted by the National Center -and other 
significant, , national ,r-esearch and development ' initiatives In-- 
directly., it should contribute to a variety of research and 
development initiatives at- state and local levels. ^Several fea- 
.tares characterize the strategy for this effort. One is the - 
defii^ition of a need as a discrepancy between^hat is anc| what . . 
ought to be- Goals and objectives of vocatiori^l pducation were 
compared with the current reality to identify those discrepancies 
which^ define signi f ioant ^need^s , ''Historically it has been diffi- 
cult to establish a widely accepted . set of vocational education" ^ 
needs, partially because of the diversity .of values and go^ls held 
by those affected by and .concerned with vocational education*. 
This report does_ not attempt to resolve these d,if f iculties or to 
provide a consensus set of national goal s or' needs. As 'the report 
was prepared, however,' the importance' of involvement and in^^ut 
from diverse source^ was recognized • 

* 

A second feature of this effort was itq reliance on available 
sources of * information anc^ data, FoLlowiJig the stipulation in the 
National Center's statement of Work, the iritent, in general, is to 
avoidvnew data collection initiatives- — a stipulation somewhat in 
conflib^^ wrth the objective of including a variety of individuals 
af f ected'^:'by or conce^tffed with- vocational education . Whenever 
possible in the selection o'f panelists or consultants, attempts 
were made include ' individuals with varying professional res- 
ponsibilities* However, with the limited number of individuals, 
involved ih these capacities, no claim is made that , those selected * 
are representative of all people concerned with vocational educa-^ 
tion. . ' ' 

This report is the first in what is aeen as -a cyclical effort* 
The strategy in "this first year is to analyze currently available 
'sources of inf ormaticjn to identify R&D need^. Then, in subse- 
quent years, 'the plan is to systematically expand and diversify 
thosQ sources of information and to seek additional means for 
identifying and ,selecting research and development needs.' Each 
year's report will provide a reeva^luation of status, relative to 
goals, and update the previous assessments. While subsequent 
repor'ts may not necessarily recommend, an entirely new set of 
research and development needs each year, thfey may expand' the 
list as significant new needs are created or detected and, over 
time, they may note significant progress toward the reduction, or 
crimination of neods. Status and progress assessments will be 
based on completed work and will not attempt to pr^fe'judge the 
effects of wor»k in progress^ These procedures are intended to 
'p|pt)vide for a fast start-up the first year arid continued expansion|^ 
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of scope and capacity rn subsequent ^years . In' general^ the mdjor 
operationar objectives, of this fijrst year, effort are to: " ' 

If Identify .anci^. assemble information on needs in 

vocational education. - \ ' ^ . 

2. Analyze- information and .data. , I 

^3. Consolidate and verify needs. 

4. Select needs requiring research and development, 

5. interpret and explain the principal research and 

development required for each need, - - . 

6. Report interpretations and fcxplanat ions . 

The procedures that were followed to achieve these 'objectives"' are 
desciribed below. ' ■ ■ ' 

, Procedures . * : 

/ . ■ • - ■ ' . 

Identification of Needs . 

■ — -.^ • ' — ' "-■ ■ — — * * 

^ . ' ► -J 
When confronted with the task of identifying needs, most educa- 
tional researchers are apt to turn to a survey, but under th^^ terms 
of the National Center contract, the Information for Policy and , 
Plannix^g Function is precluded from genorat^ing new* data bases. 
This has been interpreted as a restriction on conducting new sur^ . 
veys if existing data are .available. Fortunately the National 
Center had available two '-recent national su^cyeys of neecjs in voc- 
ational "education to draw, upon {Adams, 1977 , *arid Morrison, 1976). 
These were both attempts to identify. the perception of different . 
groups, of vocational -educators (state directors, large city direc- 
tors, RCU directors,/ teachers^ etc.) concerning the most pressing, 
needs in the field, _ ^ . . 

Working from these studies, a content, analysis technique was 
developed that could be used to code the major topics or recurring- 
themes in the documents., examined . This, system was developed by 
tallying the mav]c:)r content areas and grouping the areas where 
appropriate. The system that was d^eveloped ta code the two needs 
studies was then tested against Title II the Educational Amend- 
ments of 1 97 6 , : ' . 

When the coding system was 'judged adequate to accommodate the 
complexities of^ the legislation, it was reviewed by selected staff 
members of the National Center for internal consistency and ^ - 
clari.ty. The revisions suggested by the review were incorporated . 
and the revised system was applied to several more documents which 
arc listed in Chapter 2. The coding categories which were finally, 
used are shown as the general needs and specific subneeds in thQ 
documentation of needs in Chapter 2, 
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The f i-nal- *codiny system yielded. a set of fifteen 'general 
.needs in vocational education which are 1 isted ^ in Chapter 1. 
Figure A-I "in the Appt^ndix shows -the freauency with^ whi^h" the 
fifteen tleeds were coded in the docXiments that weif'e' analyzed, - - > 
Most of these major needs had 'a number of ^subneeds,- and' Tables A-1 
through A-4 in the'^'Appendix present a detailed summary of the. 
coding of ; the needs .and subneeds fey , document • - . ' ' ■ ' 

. " ' " ■ ^ ; -\' ^ y : ^ ' . 

Ve^r if ication of Nee^^ * ' ' * , • . > .^-^ : ' 

The fifteen nfeeds .wert^ revie^red by two^ panels: on^ had been 
assembled '^o £issist the, National Center sta^f in 'planning a 'report \ 
on the sta.tus of vpcatio'nal . education ; the second was assembled 

**»sppci f ical ly to review .the fifteen needs. The' first pa/iel con-", 
sisted of ^ staff member^ from J:he Natiotial Advisory Council on 

Vocational Education and one from the" U.S., Office of Ed,ucation/ 
a state (^firedtor-, and three researcher s . The second- panel con- 
sisted of two former associate commissioners of what is now the 
Bureau of Occupational and Adult Educatiori, one former and ope 
current state director, a. staf f ^member and an appointed member 
pf th|^ National Advisory Council on VocatioVial Education, "^nd two 
leading**scholar s of vocational education. Ea'ch of ^ these panel 
members- reviewed tbe list which is presented in Chapter 2 and ^ 
agreed that these are dur^able and pervasive needs T Several of the 
panelist's also added needs, 

" JThe' members of the second panel also selected from among the 
15 nefedfe the. five' that t?iey considered the most important for 
future R Su> P of forts . In making these judgments they were a^ked 
to" balance th^ importance of the neeid and the f^otential impact 
R&D could have. When the responses were received from the panel, 
each member waa contacted and' interviewed about the needs selected 
for R & D. The interviews focused on the kinds of issues un^der- 
lying tlte needs that the pantil-ist would like to see explored*. ' 
Summaries of four of. these interviews are presented ' in the Appendix. 

Tlio inf'ormation received from the panelists was then consid- 
ered 'with the documentation of^ need-s- that had bAen developed from 
the 'Content analysis of^tha- legislation and otli^ 1 i tergture , From 
thego* two sources the following five needs wereSf^^elected for further 
examination: coordination, curriculum content:, ^ahd "instruction, 
data collection and evaluation, planning and transition from 
school to work. ~ • ^ ^ ' 

.t ' The? critgria used to select* these fi^e were as follo^v^s: 

1, The 'neods wore 'nominated by at least three of the eight 

pa^ielists. ^ (All but one were nominated by f oilr% ) ' ' 

2. ' The needs did not require more resources or better 

adl^iinistration and coord ination of existing resources ^ • 
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, . (The need '"coordination" does not fully meet this 

cri'terion-; however, it was selected by five of .the. eight 
panelists and appeared frequently .in the other -documen- 
■ . tation . ) , ' ' ' 

' .' 3. The needs can be' addressed by existing research tnethods 
^nd technology, . " " ^ 

4. I^esearch and development efforts directed to the needs - 
hay e the proraiae-'of ^^eld-tng knowledge o'r tools of 
direct use to the fiel'd. 
^ ». _ ; 

Once these f i^e' need areas were selected/ literature citations; 
.and peer nominations were used to identif ^Consultants who could 
develop background papers on R & D within the selected areas. In 
choosing consultants an effort was made' to achieve a balance be- 
tween academic researchers and individuals with* direct administra- 
tive responsibility. ' In most of the need areas this was achieved. 
Overall, the'total was six academics, five administrators and 
one independent consultant The^ names, titles and affiliations 
of these copsultants are given on the section headings for the 
papers which are presented in Chapter 3. ( Since the needs are so 
broad, most of the consultants addressed specific subneeds. These 
had been identified from the documentation and interviews with 
verification panelist-s as among the* most pressing concerns in the 
general need area. . , ^ 



CHAPTER 2 : 



MAJOR NEEDS OF VOCATIONAL EDUCATION*; 



' ^;l,}!i^^is chapter summarizes selec^fc«4i..,,id:^umen which were 
'•^l^fiiyfed to identify major needs in vocational education. It 
was considered essential. to have some agreement concerning the 
most important needs facing the field before attempting to 
determine which are most appropriate for research and develop-* 
ment efforts. In conducting the content analysis a heed was 
.defined as a* discrepancy between actual and desired levels* of 
performance. In many of the documents that welre analyzed^ this 
discrepancy had to be^ inferred. The' analysis yielded the follow-- 
inq list of 15 need areas; ^he list is alphabetic and no priority 
order is implied: 



1 . 


Availability of Programs 




2. . 


Caredr Development Programs 




3. 


Community (citizen) Involvement, Participation and 




Communication ^ ^ - ^ 


> 


4. 


Coordination 




5. 


Curriculum 'Content and ■ Instruction 




6* 


Data Collection and Evaluation 




7. 


Equipment and Faci 1 ities 




8. 


Funding 




9. 


Interaction with Employejs/Unions 




10. 


' Personnel Development 




H. 


Planning 




12. 


Research and Development 




13. 


Sex Discrimination, Sex Stereotyping/Equal 


Opportunity. 


14, 


Special Needs Groups 




15. 


Transition From School to V^ork 





The documents analyzed to identify these needs were selected 
cither because of their significance , e.g., Title II of the E du - 
cation Amendr.ients of 19 76 , or because they represented systematic 
attempts to determine the maior needs and prolplems facinq the 
field. 

« 

The format for reporting the needs and relevant^ content 
analyses is consistent throughout the chapter. Each need area 
is first stated, ^o'.q., "availability of programs," "career 
development programs," etc. This is followed by a general need 



*This chapter was prepared by Bruce J. Shylo, Graduate 
Research Associate, The National Center for Research in 
Vocational Education. 
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statenient' ,and specific .i^eed statements where appropr:iate . 
Relevant, citations from the Ed ucation Amendir^ents of 1976 appear 
with most need statements. Since some topics are mentioned 
many times in the law, only the, major reference is specifically 
quoted. Analyses of pertinent documents for ^ach need area 
fpllow immediately in a section titled "Other Sources^" The « 
sources used'and the methods .useS to cite them are as follows: 

Title II of the Education Amendments of 1976 (PL 94-482) . 
'is cited as legislative" authority - 1976 Amendments The 
numbers following the citation 'are the section and para- 
graph numbers. • ' . 

Morrison, ^E. J,. "National -Survey of Vocational Edu-; 
cation Needs." Mimeographed. Golumbua^ OH: The 
Center for Vocational' Education, The Ohio State 
University, 1976. ' . . * 

This was a national survey of local and state vq-- 
cational educators conducted by the Center in 1976 
and 'is cited as Morrison, 1976. Needs were ranked 
on the- basis of the mean group rating for all 
respondents. . • ^ I 

NationaJL Association of Manufacturers. . gl^ecdndary Voca - 
tional Educa tion . NAM Public Policy Repor t. New York : 
Author, .1975. ^ ' ^ 

Tiiese are. the conclusions and recommendations of 
i the J^AM education committee task force -after its 
in-depth study of secondary vocational education. 
It is cited as NAM, 1975. 

Adams, Kay^ A. "National Large Citie^s Vocational Edu- 
cation Needs Study." Mimeographed. Columbus, OH: 
The Center for Vocational Education, The Ohio State 
University, 1977. 

This is a national assessment which identifies 
needs for vocational education programs in large 
cities and r£inks them- according to their mean 
•ratings as perceived by urban vocational edu- 
cat6rs. Participants included individuals at the 
district level in 106 large cities.^ Tt is, cited 
as Adams, 1977. ^ ' ' ' 
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Ellis, L. A Report to the Natiion on Vocatiop^l 
Education . Flagstaff, AZ: "Northern Ari2ona_^ Un'i- 
versity,; 1975^ V , 

In this'report Ellis cqmpares the performance 
• of vocational, education to the intfent of the 
1968 Vocational Educatiorj Amendments. It is i 
cited as'Eiris, 1975.- ^ . • ' ' ' 

. • ■• ' ' ' • 

Alabama, Ari&ona, Idaho, Kansas, Maine, Nem^Jerse y, 
'' -Texas, Virginia, Wisconsin and Wyoming Annual and. 
Five Year^{1978-1982)- State Plans fgr Vocational Edu - 
cation . ' """^ ' 



1 r 



One State Plan per^ URO"E ^Region was reviewed. Using . 

random numbers' tables, 'plans were randomly select- • 

ed from an alphabetized list of states within each, ^ 

USOE Region ... They are cited- as State Plans, 1977. ^ 

The Comptroller General of the United States. Wh at is 
the Role of Federal Assistance for Vocational Education ? 
WashingtoTi, DCT GeneraJ Accounting Of f ice 1974 . _ 

' . " " ' ■ 

This report focuses on selected aspects of second- "* 
ary and postseconciary vocational edugation in , 
' seven states and discusses some underlying factors 
that inhibit attainment of objectives. It is cited • 
as Comptroller General of the United States, 1974. 

National. Advisory Council on Vocational Education^ 
Review of GAP Report on Vocational Education . 
Washington, DC: Author , 1975 

This Report analyzes the specific issues raised 
in the Comptroller General's report and suggests 
how the problems it cites should be dealt with. ' 
it is cited as NACVE, 1975. 

National and state Advisory Councils on Vocational Edu- 
cation. The Impact of the Vocational Education Amend - 
m^^nts of 196 8 ... Washington, DC: Author , 1 974 . 

Thi_^ report was prepared for Congressional Over- 
sight Hearings concerning what form new "federal 
legislation should take. It is cited as NACVE, 
SACVE, 1974. 
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Committee on Vocational Educatiorj - Research and Development, 
Asse s sing Vocational Education Research and Oevelopment . 
Washington, DC: .National Academy of Sciences^, 1976 . - ^ 



-This document/exami^es the research a^d develop- 
ment activities sponsored by the Offip6 of Edu-^ 
cation under the authority of the Vocational Edu- 
^ .cat:ion Act of J963 as amended in 1968, and recom-- 
mencjs changes in R & D policies ancj programs for 
the coming decade. It is cited as'COVERD; 1976.- 

Jennings, John F.,; and Ra^dqliffe, Charles W. 
Commentary on Legislation Affecting Vocat ion al Educatio n^ ; 
Research a nd Dev elop ment. Occasional PaperHNo. - 
. ColumbusT^OHl fhe Center' for Vocational Bdacat^gfi^ 
The Ohio StSte IJniversity , 1977. ' ■ v 

y ' 
. . This was a. paper- delivered to a staff development , 
seminar at th^ Center in March, 1^77, and addresses 
the Vocational Education Amendments of 1976 as they j 
affect vocational 'educjption research. It is cited 
as Jennings ajrid Radcliffe, 1977. 

''^jj' . * 

■Halperin, Samuel. Eme^rging Educatj.on Policy Issues in, 
the Federal City: A" Report f rom Washington . Qcc^asional 
Paper No., 42. ifcolumbus, OH: \"The National Center for Vo- 
cational EdT^catjjion, The Ohio State University, 1978. 

This paper wa;s delivered to a staff develNopment 
seminar at thg Center In January,. 1978.' It con*-" 
tains- criticisms of vocational education that ten 
key congressional staff meml»ers -have heard members 
of Congress ekpress in tfte recent .past. It is 
cited as Halpei4^, 1978 . 

•The documentatidn. for each of the fifteen needs constitutes 
4:he rest of this chapter, h^ut one further note should be added: 
Because of the massive ajnounts of data covered, in this report, 
it was not. feasible to provide specific page citations for all i 
^ the finding's summarized in the text, * The original documents/ 
however, have been coded and specific citations are. available 
upon request to the National Center. 



2-4 



. Availaliijity^ of Progtams 

* 'I — ■ » . — . "> I" - y I — ■■ ^ w 

General Availability/ - Any in^dividu^l who is interested in vo- 
cational education training should^ have access^to appropriate 
programs • ( Note : . This category Involves having appropriate 
programs avaTTaBle within reasonable travel distance. It does 
not include providing services 'tp enable persons with special 
problems to succQeed in vocational programs;, these services ^re 
**liste3 as a separate njeed.)"^ ^ 

Create or expand availability for specific groups: (Legislative 
authority 1 97 6* Amendments ) . > ^ 

1. Adults - course or courses for persons who have completed 
or left '.High school to prepare them to " enter , re-enter or 
t^progress in the work force. The amendmants state. 

It is also the purpose of this part to Authorize ^ 
^ Fedelral grants to States to assist- thejfi ... so 

that persons of all ages' in all coinmui^ities of the 
^ * State f those -In high school , those wHt) have com- 

pleted or discontinued their fqrmal Education and 
are preparing to enter the labor market, those 
who have already entered the labor market, but 
nee.d to upgrade their skills or learn hew ones,'". 
. will hav<^ ready access tg^ vocational training 
or retraining which is 'of hig^ quality, which is 
realistic in the light of actual or anticipated 
opportunities for gainful employment, and which 
is suited to their needs, interests ;^and abilit;y 
to benefit from such training. ' (Sec. 101) 



2. Postsecondary - distinguished from ^adult by an organized 
program of study . , . 

It is also the purpose of this part to authorize 
Federal grants to States to assist *them . , so 
■ that persons of all ages in all communities of w.^^ 
the State ; ... and those in postsecondary 
schools, will 'have ready access to vocational 
^ training or retraining which is of- high quallj^. 
ty, . \ . (Sec. 101) ^ 

3. Unemployed, out^of -school youth - 

For each fiscal year^ at least 15 per centum of 
each State's allotment under section 103 shall be 
used to pay 50 per centum of the cost of voca- 
tional education for'. ^"(2) persons who have 
completed or left high school and who are not 
described in paragraph (1)^, (Sec. 101 (c) (2) ) 



Undetemploi^ed youth and adults who seek to progress in a 
career or change to a new, career pd[th 

It is also the purpose of this part to authorize 
Federal grants to States to assist them - . . so 
» that persons of all. agefe in all communities, • 
*those who have already entered the/labor market, 
but need' to upgrade their skills or learn 'new ones, 
■ . will have ready access to vocational training 
or^ retrainina which is of high quality (Sec. 
101) * ^ ^ • . ^ - 



Removing locational ' barriers ^ fovr rufa^ or inner city 
residents | ' ' 



Funds available to the States' und^r section ^130 
(a) may be used fo^ contracts, as part tof the com- 
prehensive pl^ns of program improvement mentioned 
in section 131 (a) , for the support of exemplary 
and innovative programs , sincluding- . . . 

(1) program's designed to develop hi^h quality 
vocational educration programs for urban 
centers with high concentrations of econom^ 
icaliy disadvantaged individuals, unskilled 

^workers, and unem,ployed individuals; 

(2) programs designed to develop training oppor-- 
tunities for persons in sparsely populated 
rural areas and 'for individuals migrating 
from farms to urban areas; ... 

Funds ... may be used for the construction, equip-- 
meijt, and operatioTi of residential schools to pro- 
vide vocational edi4Cation . , . In using funds avail-' 
able under section 120 for this purpose, the States 
shall 'give special consideration tcy'the needs of 
large urban areas and isolated rural areas ... 
(Sec. ^32 (a) (1) , & (2^) 



Women 

Any State desiring to participate in the programs 
authorized "by this'Act shall also assign such full 
time personnel as may be necessary to assist the 
State board in fulfilling the purposes of this Act 
by - . • . (K) assisting local educational agencies 
and other interested parties* in the State in impro\^-' 
ing vocational education opportunities for women; 
. . . (Sec. 104 (b) (1) (H) . * 



' Qt hor Sources ' . -* • - ' 

high priority needs, according to consensus of alL respondent) 
groups, included improving and expanding vocational education to \ 
meet the needs of adults and improving and expanding vocational 
education to meet the needs of handicapped individuals." Medium 
priority needs included impxoving ami expanding vocational^duca-^ 
. tio^i to meet the needs of disadvantaged individuals and improving 
and expanding vocational education to meet the needs of indivi^ 
duals who are in sparsely populated rural areas! (Morri'son, 1976) 

In her study, Adams reported fifty needs statements for 
vocatio'nal education in large cities . Each statement Was rated . 
on a five point ^cale and the mean ratings were ranked from 1 
J[ • (highest need) to 50 (lowest need). The need statement, "Availa- 
bility of vocational centers and tactics for attracting students 
to them" (p. 114) was ranked 39,5 out of 50 (medium low) whereas 
■ vocati)Dnal programs for early school leavers and unemployed youtl^ 

"I- was ranked 43.'5 (lower). (Adams, 1977) 

- In ireporting enrollment trends during the 1971-1974 period, 

Ellis documented the growth of vocational educ^,tion| particularly 
/ ^ in 'l^he areas of adult and postseconBary program^;. she felt that 
technological changes would increase the dem.and "^or more sophis- 
, ticated/preparation for the world of work and^^^^t 'recent atten- 
tion to continuing education and life^long l^rn^g would encour^ 
age increased offerings at' the postsecondary. and'^adult levels. 
{Ellis, 1975) ' ^ ^ 

,,pne half, of the 10 state plans which were^' reviewed included 
a gei?eral statement about increasing the availability of vocation-- 
^ al education programs f6r those desiring access to them. A 

similar number listed expansion of postsecondary programs as a 
- , goal. A majority of the state plans included ^oal 'statements' 

relative to making more programs available ,to' unemployed, out-of^ 
school youth. Removing lo^ational barriers was also cited as a 
need by almost onc^ half of state plans. .The ne^d areas of 

women, underemployed youth, and adults received very little 
attention. ' (State' PI ans , 1977) 



In assessing the impact of the 1968 Vocational Education 
Amendments, the National and State Advisory Councils on Vocational) 
Education called for the continued expansion of vocational educa-- 
tion programs. Thoy cited the high youth unefnployment rate and 
the waiting lists of students anxious to learn skills but unable 
to enroll in programs as reasons for continued federal support 
£0r the expansion and strengthening of the vocational education 
System. (NACVE, SACVE , 1974)' ' 

■ J 
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The Committee on Vocational Education Research and Develop- ■ 
men t \,( COVE RD) observed that educators are now required to provide 
equad program opportunities to all students and noted that voca- 
tional education ha^ been encouraged to eliminate sex 'bias from 
its programs. " The committee questioned the'exteht to whieh these 
requirements are being met and asked how- vocational education can 
best s'erve the disad^^-antaged . (jCOVERD, 1976) 

* One of the common congressional criticisms of vocational ' 
education ijalperin noted was that "vocational education is too 
institution-oriented to school-age populations and doesn't care 
"'enough about the unemployed and, about out-of -school youth. Thus, 
the nation is forced to create an array of costly job training 
programs , outside the formal educational structure." (Halperin, 
1978 p. 12) 



Career Development Programs 

/ General - Programs should^be developed and implemented to 
improve the awareness, exploration, planning^ and decisi'on^making 
ability of individuals with regard, to career opportuiH ties and 
career developments i 

Specific Types of Programs: (legislative authority - 1976 

Amendments r i 

I 

1. Career Education Program^ 

, programs and p^rojects designed to famildarize 
elementary and secondary school students with the 
broad range 'of occupations for which special skills 
are required, and the requisites for careers in 
such occupations:-,,,. (Sec. 132 (a) (5) (a)) 

2. Vocational Guidance and .Counseling 

, Not less than 2 0 per centum^ of the funds available 
to the States under Section 130 (a) shall be used 
to support programs for vocational development 
guidance . and counseling programs and services 
which, subject to the "provisions of subsection (b) , 
shall include - ■ , v 

, (1) initiation, implementation , and improvement 

of high quali ty vocational guidance and 
counseling programs and activities; 
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( 2 ) vocational counseling for children , youth , 
and , adults, leading tp greater | understanding 
^f educational and vocational options . • . 



{5 ) vocational and educajtional counseling for 
* youth offenders and Adults in correctional 

institutions; . 

^ (6 ) ^ vocational guidance and couseling foir persons 
■> of limited English-speaking ability . - 

^ (7) establi^shment of vocational resource centers 
to ineet the special needs of out--of --school ^ 
individuals/ Including individuals Peeking 
second careers , individuals entering the Job 
market late in life , handicapped individuals, 
from economically depressed communities or 
areas, and early retirees; and (Sec* 
154 (a)) 

3, Programs to Develop Positive Work Habits • ^ 

(No legislative reference) ^ 

Other Sources , , * • * 

.According to a consensus of all those responding ^to the 
National Survey of Vocational Education Needs, a high priority 
need was . that of providing comprehensive voQW.tional guidance, 
counseling , placemept^ and follow-up services to '-^ll who need them; 
This need statement \ranked sixth highest out of forty-eight state- 
ments ^orrison, 1976) ^ . 

In its report Secondary Vocational Education , the National 
Association of Manufacturers <NAM). cited three conditions which ' 
they felt contributed to the ineffectiveness of some voca*tional 
programs - the lack of student familiarity with the "world of 
work" prior to reaching high school; the lack or program flexi- 
bility; and the limited occupational counseling received. NAM 
issued s©ven policy statements addressing these conditions, three 
of which directly relate to career development:. 

1. All students' learning exper^iences should include 
general orientation to the world of work beginning 
with^the elementary grades, .... 

2. Secondary vocational education students can be served 
better by programs which integrate both academic and 
occupational training into a total education environ- 
ment so as to provide students with the opportunity 
to develop social and self concepts, (and) propet: 
work attitudes, .... 
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6. Parents , ^students, educators and guidance 'counselors 
should become more aware of the critical importance 
^ of developing students' occupational orientations 
wto enable them to get jobs and achieve full career 
potentials. (NA^l, 1975 p, 11) ' 

Several high priority needs relative to career development • 
were, identified by distract level vocational education personnel.^ 
Included among the highest ranked ten specific needs for voca-- 
tional education were: 

* 

- counseling prior to enrQllment to assist students in > 
' ' ' clarifying their purpose for enrolling in vocational ' 

education, and in selecting the right programs (Mearf 

rating ranked'' 3. 5 out of 50) ^ 

* 

allocation of counselor's time^ so that an adequate 
percentage is spent in f ace-^to-f ace counseling with 
vocational students (Mean rating ranked 5.5) 

counseling for students with negative attitudes 
toward work, the educational system, themselves 
and/or^ others . (Mean rating ranked 9.5) . o 

Other high priority needs cited by district level personnel Were: 
providing systematic counseling for all students; instituting 
testing programs to include interest and aptitude testing for all 
vocational students, ninth grade through adult; and providing 
opportunities for students to develop positive work habits. 

Fully 18 percent, or nine of the top fifty ranked needs concern 
vocational guidance. This finding is consistent with the results 
of a parallel assessment of national major goal priorities for 
urban vocational education. Large city directors of vocational 
education were asked to rate thirty major goals on a three point 
scale from (1) lower priority, (2) medium priority, to (3) higher 
priority.. Responses to the goals were summarized to provide mean 
ratings which were then ranked from highest to lowest. Of the 
ten highest ranked goals, four were related to < guidance and 
counseling. Th^^second highest goal overall was to provide com- 
prehensive guidance and counseling services so vocational students 
can better select careers and educational programs suited to their 
interests and abilities. (Adams, 1977) 

Ellis reported that the career education movement seems to 
be gaining momentum nationally. She represented the vocational 
educator's viewpoint when she said that, career education is a way 
to provide career orientation and exploration experiences and to 
develop positive attitudes towards work in the elementary and 
middle school grades. As more academic educators become involved, 
she sees the dichotomy between academic andtvocational education 
being reduced, which would result in a situation where "education 
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yilX begin preparing stuc^ents fot vocations as wel.l^ as - 

avocations. ";,JtEll is 1975 p. 35) ^ ' . ' ^ . 

'• ' - * ' . • ' • ' 

P ^ All 10 stat-g plans that "were reviewed cal^ f or ' inlproving 

and/oir expanding vocational guidance a,n'd counseling activities. 
** In several ^instances pai;ticular mention was made of the need to 

provid^ guidance services for wom^n^ the handicapped, those out- 
" ofrschool, and for heads of households whose roles are qhanging, 
few plan^ identified specific ca^-eer education programs to be 

implemented. These h^d to do jSrlmariiy with integrating career 

clusters into ti^e curriculmn and establishing homemaking educa- 
<r tion programs for elementary and middle school pu^il^' (State 

Piai\s, f9^7) -. ; ,.- ^ 

^ finding of the OAO report was that guidance services for; " 

students enrpilei'd in vocational educa^tion pre inadequate. 
Def iciancies ;cited included few cooperative arrangements with the 
sy^t^ni of public employmen'^ offices within states, inadequate* 
student exposure to the ifange of occupational options available , 
and the.vacademic orient€u:ion of school counselors. The report: 
refe^e'd t;o various national and state studies which b'onclude: 
tha^ more considera^^^should be given to vocational career 
planning. (ComptrOll'(|HB|eraI of 'the UnitecisiStates , 1974) 



NACVE responds* to the -GAO report charge^ that "occupational 
guidance has t\6t received adequate attention" by referring to 
their 6ixth Report (1972)^ which focused /entirely on changes 
needed in guidance' and ^co^unseling %^i5vrices . They claim that con- 
/ ' siderable progress has been ipade irj '^^is^area of occupational 

' guidance but recognize that much remains tb be djone. (NAGVE,1975) 

* In making 'their recommendations tOv^^^he committee developing' 

the oversight hearings oH' PL 9*0-576 ^ (Vocational Education Amend- 
ments of 1968) , Vhe National and Sta.te Advisory ^ Councils reported 
'that, a strong ^^eral vocatiOna:i,>^ducation law was needed to en- 
- courage tl^e (^{5ntinued growth of vocational Education, allowing 
flexibility so th^t states can best , meet, the ^particular needs of 
their citizens , while retaining some provisions to assure that 
federal priorities' are met. The councils also suggested that the 
committee ra^ise certain questions, Onp question directly related 
to 'Career, development programs -was, "Should distinctions be made 
in federal legislation l^etween pre-vocational career education 
and vocational skill training?"' (NACVE, SACVE , 1974, p. 9) 

Several findings were reported .by COVERD relative to the 
concept of career education. The cpmmittee determined that re-- 
> ^ search has not yet evaluated the effectiveness or established an 
empirical or theoretical basis for career education. Potential 
areas of resea;;'ch noted were determining'' "at. what point in a 
student * s "education knowledge about jobs and careers should be 
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introduced/ when specialized skills should be taught, or how 
career education can be individualized for studjentB. with, differ- 
ing needs^ and ambitions.'* In reviewing previous R&D the com- 
mittee concluded that "vocational education needs mbre knowledge 
of how. and why- people choose ^nd change careers." icoVERD/ 1976, 
p. 12) . , . * . 

Community -(Citizei^)^ Involvement , 
Participation ajid Cemmuni cation • . - 

General.- Ther^ should be efforts for greater intera;c4\on , 
involvement and -communication with c^omraunity representati'^fes {hot 
including involveijient of employers or labor unions which is. list- 
ed as a separate need) . • * 

Specific types of involvement and communication : (legislative 
authority — 1976 Amendments) 

1* Establishing goal^ 

The State board shall ^> • • • (^ijpnduct a series of public 
hearings, ... in order sto permit all segments of the" 
population to give their views op the goals which 
ought to be adopted in the state plan, ... 
(Sec. 107 (a) (2) ' 

2. Development of curricultjam (advisory groups) ^ 

The State board shall, ... conduct a, series of public 
hearings, ... in ord^r to permit all segments of the 
population . to give their views on the goals which 
ou^ht to be adopted in the state plan, including the 
courses^ to be pffqred, the allocations of responsi- 
bility for these . courses ... (Sec. 107 (a) (2) 

Each eligible recipient receiving assistance under this 
Act to operate vocational programs shall establish a 
local advisory council to provide such agency with 
advice on. current job needs and on the relevancy of 
courses being offered by such agency in meeting such 
needs-. Such local advisory ^councils shall be composed 
of members of the general public , especially of repre-- 
s^ntatives from business, industry, and labor; . . . 
(Sec. ]05 (g) (1) ^ V ^ 

3. Evaluation of prdgrams 




4. Specific reference to National Advisory Council 

The' National Advisory Council on Vocational Education, 
establ-ished pursuant to section 104 (a) of the Voca-. 
tiohal Education Act of*1963, in effect prior to the 
• enactment of the Educational /Amendments " of 1976, 
shall continue to exist during the period for which 
appropriations are authorized under , .this Act. 
(Sec. .162 (aj ) ' ' 

5. Specific reference to State Advisory Councils 

Any state which desires to particij3bite in programs 
under this Act for any fiscal year sl;all establish " • 
a State advisory council, ... (Sec. 105 (a)) 

6. Public image ^ -the image that vocat(Sbnal education 

' has in the community should be improved; there ghould 
be more effective presentation of the benefits of 
vocational education. . ' 



Other Sources - ^ 

According to all respondents of the National •Survey of 
Vocational Education Needs ^ the Second highest priority need was' 
to better communicate th^ benefits and con^ient of vocational 
education to parents, students^ employers, and general educators • 
Among respondents at the local level, this need statement was ^ 
ranked number one. (Morrison, 1976) . 

The NAM report determined that one, factor coivt'^i^uting to ' 
the inability of vocational education to satisfy the needs of 
students was, "The negative attitudes of parents, businessmen, 
and nonvocational educators toward vocational education v;hich 
influences counselors not to direct students into vpcatioosl 
education -except as a last resort." * (NAM, 1975, p. 8) 



4 



Vocational education directors in large cities -felt a high 
riority goal was to "better communicate the content and benefits 
of vocational education to parents, 'students, and all general 
educators." (p. 103) This fee.ling was reflected in several high 
and medium priority need statements. District level vocational 
education personnel thought increasing parental awareness of the 
goals and- opportunities available in secondary and post-secondary 
vocational programs as compared to college was a high^ priority 
heed. Up-dating the image of vocational education, increasing 
the awareness of counselors about vocational education programs, 
and improving general community awareness of available program' 
offerings were all perceived as medium needs. (Adams, 1977) 
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In Ellis's .view the National and State Advisory Councils 
haye met the inteht of the 196 8 Amendments to bring about citizen 
participation in the establishment of goals for vocational educa- 
tion and in the implementation of programs. The National Advisory 
Council, she reported^ has be^n an effective force, insuring that 
general public concerns are expressed with regard to the national 
vocational education program'. Although she recognized the valu- 
able contribution made by SACVEs in advising State Boards for 
Vocational Education and in evaluating vocational education pro- 
grams, services, and activities, she cautioned against allowing 
them to assume administrative responsibility 'for programs. 
(Ellis, 1975) 




•All of the ten state plans provided for a state adviacsry ' 
council and many mentioned local advisory councils. Only one, 
however, listed increased community involvement as a goal or 
objective for the coming years. It made specific reference to 

ivolving community members in establishing goals. (State Plans, 
19^ 




appropriate role and function for advisory committees. GAO 
recommended to the Secretary, HEW, that the Department -should : 



expand its effort to enforce the requirement that 
^•IJ., local and State education agencies, in planning 
vocational programs^ iden^tify- the needs of public 
and private business , ^industry , labor, and students 
and that those needs be considered ■ the primary basis 
for decision making about provision of vocational 
services supported by VEA 
• {Comptroller GeneraT of the United States , '^974 , p, 35) 



s 



NACVE respo'nded to' the GAO charge that advisory council 
evaluations are limited by contending that SACVEs have borne _ • 
most of the responsibility for prodding state boards of vocational 
education to comply with^ the requirements of the law* The NACVE 
review maintained that the state councils, even with severe fund- 
ing limitations, have been an effective voice for the needs of 
the people. The main lament of the stat6 councils was that they 
have no statutory enforcement power. (NACVE; 1975) 

The stafce advisory councils viewed themselves as autonomous , as 
being consulted on relevant matters /and As the bodf whose recommends 
tions were implemented. State directors of vocational education, 
once antagonistic toward the coiancils, have been moved to commend 
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them for their effectiveness in determining vocational education 
"program' needs, and effectiveness." Although generally satisfied 
with the sections of the legislation which established them, some ' 
Councils expressed a desire for stronger wording in the law which 
would mandate that they 'review the extent to' which state, plans , 
are actually implemented" and allow them t« enforce compliance 
where serious discrepancies exist. (NACVE, SACVE, 1974) 

COVERD recommended that any process for identifying national ' 
or state R & D priorities should involve advisory groups that - 
represent the clients of vocational education, including students, 
employees and employers, and professionals' in vocational education. 
They further recommended that the terms of advisory, group" members, 
be sufficiently long* to allc^w setting long-term priorities'. The 
process should be well publicized so that 'those wishing to parti- - 
cipate can do so. (GQVEItD, 1976) 

» ■ . * ■ ' , ' " k . ' 

In discussing the current (Carter) Administration's educa- 
tional leanings, HaJperin noted an "encouragement ^ for process- 
oriented irequirements . " Thus., Halperin thought tiiat new legisla- 
tive proposals might encourage school-wide anS district-wide needs 
assessments to increase local' involvement and' to highlight differ- 
ent needs and prescriptions for the subgroups served by various 
schools. . 

Halperin also noted that while congressmen look with favor ' 
on vocational programs in their home districts, they tend to 
criticize' vocational education in general.- (Halperin, 1978) 



eCoordination 

General - Vocational 'e(;3ucation should be coordinated with 
academic education to enhance relevance and there should be 
greater articulation across post-secondary, adult, and Department 
of Labor training programs. (legislative authority - 1976 
Amendments ) . . ^ 

Funds available to the States under section 130 (a) 
' m^^y be used for contracts, as part of the comprehen- 
sive plans of program' improvement mentioned in section 
131 (a) , for the support of exemplary and innovative 
programs, ^including - ... (4) establishment of -cooper- 
ative arrangements between public education and man- 
power agencies, designed to correlate vocational 
education opportunities with current and projected 
needs of the labor market;.... (Sec. 132 (a) (4) ' 
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Any State desirihg to receive the amount for which 
it is eligible for any fiscal year pursuant to this 
Act shall, through its State board, submit to, and 
maintain on file with, the Commissioner a general 
■application providing assurances - .... (4) that funds 
will be distributed to 'eligible recipients on the 
basis of annual applications which - . . . (C) ^describe 
how the activities proposed in the application relate 
to manpower programs conducted in the area by a prime 
sponsor established under the Comprehensive Employment 
and Training Act of 197 3, if any, to ass^ure a coordi- 
nated approach to meeting the vocational education 
and training needs of the area or community, ... 
(Sec. 106 (a) (4) (C) 

The annual program plan and accountability report 
shall be submitted to the Commis'sioner . \ . This plan 
aniS report shall contain: ... (1) planning provisions 
which - ... (C) show the results of the - ... (i) 
\ coordination qf programs funded under this Act with 
manpower training programs funded Under the Act;" 
(Sec. 108 lb) (1) (C) (i) ) 



Other Sources 

Respondents to Morrison's needs survey gave high priority 
status to two goals related to coordinaj:ion. The first of these 
was the need to provide opportunities for all vocational students 
to acquire the basic skills required for course Work and jobs. 
The jpecond was the need to coordinate comprehensive guidance^ 
counseling r placement, and follow-up services with business, in- 
dustry^ service agencies, and manpower information systems. 
Increasing cooperation with related education areas (e.g, indus- 
trial arts, career education, academic subjects, etc.), and in- 
creasing cooperation among the various levels and departments of 
vocational education were seen as medium priority needs. 
(Morrison, 1976) 

NAM declared that, "secondary vocational education students 
can be setved better by programs which, integrate' both academic 
and occupational training ipto a total environment education to 
provide students with the opportunity to develop social, and self-- 
concepts, proper attitudes, as well as general occupational edu- 
. cation rather than .ovejr specialized training." (NAM 1975, p. .11) 

District vocational education personnel felt that one of the 
highest ranked specific needs for vocational education^ in large 
cities was "coordination between vocational and academic curricula 
so, that academic courses emphasize vocational applications and 



academic skills are improved within vocational courses .", J^. Ill) 
They also_^expressed a desire for greater cooperation between aca- 
demic and vocational teachers. (Adams/ 1977) 

' * . ' • ' ' ■ 

Elli^ saw the introduction of the career education concept 
as having positively affected the integration of academic and 
vocational education but scant data exist to support this claim. 
Ellis cited increased vocational education enrollments at the 
post-secondary level as an encouraging trend. In considering the 
proper mix between vocational education and manpower programs, 
Ellis reported that manpower programs should complement vocational 
education programs in serving those segments of the population 
which cannot be adequately served by the present vocational edu- 
cation system, e.g. those unable to succeed in vocational educa- 
tion programs, those requiring training stipends, etc. 
(Ellis, , 1975) 

\ 

The issue of coordination was addressed in several of the 
ten state plans which were reviewed. For the most part, they 
Spoke of the need for greater communication between secondary and 
post-secondary vocational programs. One plan, for example, 
addressed articulation as it relates to .the provision of programs 
for special subpopulations . Many state plans cited improving 
coordination with manpower training urograms as a qoal . (State 
Tlans, '1977) . • 

* 

The GAO report made several recommendatiohs to the Secretary 
of HEW relative to coordination. They included recommendations 
that: . ' 

. 1. HEW exp^d efforts to have SEAs and LEAs establish 

working partnerships among all institiations providing 
occupational training at all levels — secondary / post- 
secondary, adult. (p.* 35) 

2. HEW clarify the roles of various organizational enti- 
ties within HEVJ involved in occupational training and 
implement some mechanism by which these juris- 
dictior)s can engage in coordinated comprehensive 
planning. (p. 35) 

3. HEW should require th'&t LEAs in their, application to 
SEAs describe and document the nature' and extent of 
-their cooperative fefforts with other sources of train- 
ing and employment. (p. 105) 

4. HEW should work with states to increase flexibility 

in vocational education training arrangements, through 
such mechanisms as, ... pro'vision of vocational train- 
ing in nonpublic facilities so that more people can 
be trained in more occupational categories. (p. 105) 
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^ 5. HEW s^iould develop and ^fund a project ... to seek out 
successful ejfamples of flexible arrangements and 
develop model^ for use by states and LEAs in increas- 
ing flexibility in vocational training arrangements. 
. (p. 66) 

6, HEW should develop an evaluation study to identify 
Federal and* State statutes and administrative pro-^ 
cedures that limit the use of community training 
resources, ... (p. 66) 

" 1 . Congress should establish a set-aside requirenient 
for cooperative arrangements to expand vocational 
offerings and strengthen programs through use of 
. other public training facilities or nonpublic • ^ 
training resources. (p, 66) 

8. Public educational institution^ should explore 

the potential of utilizing DOD training f acil ities • 
(Comptroller General of the United States, 1974) 

The Council recognized that the coordination of both second- 
ary school with post-secondary school vocational education and 
vocational education programs with other community 'and area 

human resource programs remains a continuing problem. Althouch. 
the Council r^eported little progress in the area^ it cautigned 
its critics ^ against being tpo severe by stating that '"calls for 
reform must be tempered with a realistic apgraisal of the pro- 
blems inherent^ in* all such efforts, which may be seen by many 
organizations as an attempt to limit their autonomy."' (NACVE, 
1975, p. 10) ' . 

' COVERD reported that certain legislation and the lack of 
administrative coordination of the various Parts (C, D, & I) of 
the federally administered level research and development program 
has hindered progress. The Committee also* found a lack of 
coordination within the National Network for Curriculum Coordin-- 
ation and between that Network and other researchers. The 
Committee reinteratcd the continuing need to Tntearate vocational 
and other curriculum elements. (COVERD, 1976) 

Jennings and Radcliffe discussed how one intent of the 1976 
Amendments is to coordinate the R & D efforts of the Office of 
Education, National Institute of Education, and the Fund for the 
Improvement of Post-Secondary Education. T^iey also commented on 
Congress' unhappiness abou€"resour pes being wasted and. stressed 
the importance of coordination among agencies. (Jennings and 
Radcliffe, 1977) 



Halperin reported the current Administration moving in the 
direction of improving coordination among federal, state, and 
local programs. He saw a movement toward a better integration 
of those federal programs designed to advance the welfare of 
groups inadequately served at the state and local level. He 
discussed the need to improve coordination between traditional 
educational proarams and VEDPA and reported that several members 
of Congress think that vocational education has resisted" coordi- 
nation with other components of education and has soent most of 
Its energy protecting turf. (Ilalperin, 1978) | v 

Curriculum Content and Instruct ion 

General - Cui;riculum and instruction should be upgraded and 
improved. Spiecific Recommendations: (legislative authority - 
1976 Amendments) 

1. Consumer and homemakirig education - programs in consumer 

edxication, food and nutrition, family living and parenthood 
education, child development and guidance, housing and home 
management, and clothing and textiles should be instituted. 

, _ From the- sums made available for grants under this 
subpart pursuant to sections 102 and 103, the Com- 
missioner is authorized to make grants to states 
to assist. them in conduoting consumer and home- 
making education programs. (Sec. 150' (a)) 

Grants to states under this subpart may be used, 
... for (1) educational programs in consumer home- 
making education consisting of instructional pro- 
grams, services and activities at all educational- 
levels for the occupations of homemaking including 
but not limited to, consumer education, food and ^ 
nutrition, family living, and parenthood education, 
^ child development and guidance, housing and home 

management (including resource managejnent) , and 
c.lothing and textiles which ... (Sec. 150 (b) 

encourage elimination of sex stereotyping in con- 
sumer and homemaking education by promoting the 
development of curriculum materials ... (Sec. 150 
(b) (B) 

-give igreater consideration to economic, social, and 
cultural conditions and needs,' especially in econo- 
mically depressed areas, and such courses may 
include where appropriate bilingual ;Lns truction ; . . . 
(Sec. 150 ib'^iC) . , ■ 
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encourage outreach programs in coininunities for 
youth and adults ... (Se.c. 150 (b) (D)) 



emphasize consumer education, management of re- 
sources, promotion of nutritional knowledge and 
food use, and parenthood education to meet the 
current societal needs, ... and other means of 
assuring quality in all homemaking education 
programs such as ... curriculum development . . . 
(Sec. 150 (b) (F) ) , ■ ^. • 



Energy education - there should be. training of 'coal miners, 
supervisors, and technicians in the fields of coal mining, 
solar energy, and alternative energy sources. 

Funds available to states under section 120 itlay be 
used to make grants to post-secondary educational 
institutions to carry out programs for the training 
of miners, supervisors, technicians (particularly 
f safety personnel)", and environmentalists in the 

field of coal mining and coal mining ' technology , 
including acquisition of equipment necessary for 
the conduct of such program.', (Sec. 123 (a) (1)) ' 

Funds available under section 120 may also be used 
to make grants to post-secondary educational insti- 
tutions to carry out program^ for the training of 
individuals needed for the installation of solar 
energy equipment, including training necessary for , 
. the installation of glass paneled solar coLlectors 
and of wind energy generators , and for the instal- 
lation of other related applications of solar 
energy. (Sec. 123 (b) ) ^ 

♦ 

Relevance ~ training should be for today's labor market and 
for new and changing occupations. 

. , . ^the State shall, in considering the approval of ♦ 
such, applications / give priority to those applica- 
tions which - ... propose programs which are new to 
Ipthe area to be served and which are designed to meet / 
new and emergin(^ manpower needs and job opportunities' 
in the area and, where relevant, in the State and 
the Nation; and ... (Sec. 106 (a) (5) (A) (11)) 

Funds available to the States und&- section 130 '^a) 
may be used for contracts for the support of curri- 
culum development projects , including - 
^ ( 1 ) the development and dissemination of vocation- 

al education curriculum materials for new and chang- 
ing occupational fields ..." (Sec. 133 (a) (1)) 
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Funds available to the States under section 130 
(a) mdy be used ,for support of State re'^earclx 
coordination units and for contract^ by those 
units pursuant to comprehensive pla^s of program 
improvement involving - ... 

(3) improved curriculum materials for presently 
funded programs in vocational education and new 
curriculum' materials for new and emerging job 
fields ... • . 

(4) projects in the development of new careers 
and occupations ... (Sec. 131 (a) (3) hnd (4)) 

Other Sources 

According to Morrison's respondents, the third highest 
priority need was ertsuri/ig the relevance of^ vocatiohal curricula 
to current job opportunities and .practices through .effective 
methods for identifying, selecting/ and updating content. Other 
needs which were ranked fairly high included: -individualizing 
teaching andM.earning (e.g. curriculum) to meet the needs of 
different kinds of l^p.arners , developing curricula which prepare 
students for clusters of up-to-date occupations, increasing the 
flexibility of vocational programs, and improving the curriculum 
materials used by vocational students and educators. (Morrison, 
1976) 

In its study of secondary vocational education, NAM cited 
several weaknes^as which included: too few students receiving 
occupational trailing in areas where jobs are available or ex- 
pected to be available, and lack of program relevance. The poor 
placement rate of graduates in the area for which they were 
trained was cited as an indicator of the lack of program rele- 
vancy • NAM recommended that "the diverse educational and occupa- 
tional needs of vocational education students can be satisfied.^ 
better by a broader, more flexible range of programs." (NAM, 1975) 

Two medium high needs for vocational education, as perceived 
by district -level personnel, are, first, the systematic initiation 
of new vocational programs in .emerging occupations and fields with 
expanding employment opportunities, and, second, the development 
and use of competency-based instruction. Mentioned as a fairly 
low priority need was vocational education curricyla and 'instruc- 
tional materials for use- in open entry/open exit situations. 
(Adams, 1977) 

Ellis reports that even with limited investment, strides 
have been made in 'the design and' development of curricula for new 
and emerging technologies and in modifying existing curricula for 
ongoing programs. She comments favorably on the cluster concept 
in curricular design, seeing it as holding great promise for 
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vocational education. (Ellis, 1975) 

All of the ten state plans reviewed have made provision for 
upgrading and/or improving curriculum and instruction. Five 
addressed the issue of relevance while feeven made specific refer- 
ence to developing programs in consumer and homemaking education, 
A few state plans intended to implement energy education as part* 
of their post-secondary vocational education program offerings. 
(State Plans, 1977) 

The GAO report found that vocational training or -retraining 
oftentimes is not relevant in light of actual or anticipated 
opportuniti-es for gainful employment. The report recommended to 
the Congress that federal vocational funds directed to LEA's for 
programs be used only for those skill areas for which existing 
or- anticipated job opportunities can be demonstrated. (Comptrol- 
ler General of the United States, 1974) 

NACVE responded to the charge thdt "student enrollments have 
not been aligned with employment opportunities" by recognizing 
the lag of vocational education courses in adjusting to changes 
in the labor market- This they attributed mainly to lack of 
proper planning. NACVE, however, questioned basing, the findings 
solely on placement data. " It also contended that objectives 
other than training for employment should be part of vocational 
education, for example, motivation for increasing* basic skills, 
and reducing school dropouts. NACVE, 1975) 

COVERD identified aj)^ major problem in vocational education 
the development of means for keeping curricula up .:to date and 
responsive to the needs of students. This relates to. the need 
for training students for . occupational versatility. The Committee 
was critical of curriculum development which .is totally directed 
toward a small proportion of students and instructors. They , 
called for adequa'te curridulum development in all areas, stressing 
the necessity for developing a highly flexible and generalizable 
curricula. (COVERD, 1976) , ' 

»^ 

Some criticisms of vocational education voicc^d by gaembers of 
Congress include: "vocational education provides irrelevant skills 
training for* today's job market and €?specially for tomorrow's 
economy," and "vocational education insists on maintaining traiR- 
ing ia^the old categories (e.g. T & I, Agriculture, etc.) as 
opposed to new job areas as urged by Congress." 

In translating the Carter Administration's legislative 
themes, Halperin identified individualized educational plans for 
e^ch student as a coming initiative. (Halp&rin, 1978, p. 11) ' 
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Data Collection and Evaluation 

General - There is a need for more and better data on inputs 
and processes of vocational education, better ^valuation of effec- 
tiveness, and better access to and uti^lization of data, (legisla- 
tive authority - 1976 'Amendments) 

« 

The Commissioner ,and the Administrator of the National 
Center for Educational Statistics shall . , jointly 
develop information elements and uniform definitions 
for a national vocational education data reporting and 
accounting system. (Sec. 161 (a) (1) 
» * 

There is hereby established a National Occupational 
Information Coordinating Committee which shall ... 
(B) develop and implement by September 30, 1977, an 
occupational information system to meet the common 
occupational information needs of vocational educa- 
tion programs .which system shall include dkta on 
occupational demands and supply ... (Sec. 161 (b) 
(1) (B) 

Any State desiring to participate in the programs 
authorized by this Act shall also assign such full- 
time personnel asi may be necessary to assist the 
State board i^^gy[. filling the purposes of this Act 
by - (B) gathering, analyzing, and disseminating 
data on the staus of men and women, studeri^ts and 
employees in the vocational education progr^nis of ^ 
that State; (Sec. 104 (b) ^(1) (B) 

f 

Each State shall, during the^^ive-year period of 
the State plan , evaluate the effectiveness of each 
program within the State being assisted with funds 
available under this Act;... (Sec. 112 (b) (1) (A) 



Funds available to the States . . , may 'be used for. . . 
projects to evaluate the operation of programs for 
the training , development and utilization of public 
service aides , particularly their effectiveness in 
providing satisfactory work experiences and in meet- 
ing public needs; ... (Sec* 131 (a) (4) (C) 
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The Commissioner and the Secretary of Labor together if 
shall - ... evaluate the impact of such bilingual 
vocational training on the shortages of well-trained 
personnel, the unemployemnt or underemployment of 
persons with limited English-speaking a^sility, and 
the ability of such persons to acquire sufficient job 
skills and English language skills to contribute fully 
to -the economy of the United-' States ; .... Sec. 182 (a) 



The Commissioner and the Secretary/ of Labor together 
shall - . . . develop and disseminate accurate in- 
formation on the status of bilingual vocational 
training in all parts of the United States; . . . 
(Sec. 182 (a) (1) ) 



Other Sources 

I 

Morrison's respondents ranked data collection and evaluation 
needs as a high priority. The mean rating of statements regard- 
ing the need to more effectively evaluate vocational education 
and to provide improved data for planning and evaluating voca- 
tional programs were fourth and eighth highest, respectively. 
Those surveyed viewed improving and expanding follow-up studies 
of former graduates and employer^, and developing practical pro- 
cedures for measuring cost-effectiveness of program alternatives 
as medium priority needs s (Morrison, 1976) ^ > 

NAf4 found it was difficult for those secondary vocational 
education programs lacking a viable feedback and evaluatior^ 'mech- 
anism to respond effectively to job market projections for occupa- ' 
tionally trained h^gh school students - NAM recommended that sys- 
tematic, standardized, and result-based methods of evaluating 
programs should be required . (NAJi, ' 1975 ) 

District level personnel in lorge cities per\ceived data 
collection and evaluation needs as a, fairly low priority. 
Adjudged medium low needs were collecting information atjDut voca- 
tional graduate on-the-job performance from present em.ployers, 
and collecting up-rto-datc and valid information about job compet- 
encies in certain areas. A lower ranked need was that of develo- 
ping systematic procedures for using the information collected 
through follow-ua studies to improve the educational process. 
(Adams, 1977) \ 

Almost^every one of the ten state plans reviev/ed had as a goal . 
the. improveiTient of data collection and/or evaluation. 
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Some states identified specific needs, euch as the need to 
1)' develop program standards, 2) improve evaluation of appren-- 
ticeship programs, 3) determine if equipment needs updating, 
"^l) translate studc^i: needs assessments and labor ^market surveys 
into programs, 5) study the effects of releasing seniors early 
in the school day, and 6) evaluate instructional materials. 
(State Plans, 1977) 

The GAO report concluded that the planning of vocational 
prograins should be improved at the local, state, and aational 
levels. Better data for policy formulation and planning should 
be collected 'and the data that are available -should be used more 
effectively. The report recommended that the Secretary of HEW 
should: 



- expand management evaluation^ of state and local 
vocational education programs supported by federal 
funds, (p. 35) 

- expand efforts to enforce the requirements that all 
CeAs arid SEAs, in planning vocational ^rogr^ms, 
identify the needs of " public and private business, 
industry, labor, and students and that those identified 
needs be considered the primary basis for decision- 
making about providing those vocational services 
supported by the Vocational Education Act of '1963, 

(p. 35) 

- increase efforts in the development of .vocational 
in^formation systems that will providejdata fojr'com- 
pa^irative analysis, and continuously review use of ^. 
th^t data to impirove vocational * programs . (p - 35) - 

- deye^lop with states an improved approach to planning 
which will* better meet state needs as well as- providing 
information necessary to adequately monitor and evaluate 
federal program expendi\:ures , (p. 35) 

The GAO also recomm^rded that HEW improve technical assistance to 
states so as to hel^ them to identify, develop, and apply data 
which will more effectively consider each criterion in the law. 
•(p. 104) (Comptroller General of 'the lini ted States , 1974) 

NACVE contends that what is needed is not a national^ voca-^ 
tionai education data collection effort, but a national computer 
ized information system for all education. The report cites the 
development of state management information systems as a step in 
this direction. The SACVEs recogni ze . that data are not available 
for assessing labor market needs or projections , There is a need 
for Labor Department data. (NACVE, 197S-) 
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'State councils complained that there was no common core of 
data that could be used among different agencies and that the 
data formats now being used are not translatable from one system 
to another. Although the existence of adecruate data is sometin]es 
a problem^ the greatest diffiqulty lies in obtaining it Xn a use,- 
able form. (NACVE, SACVE, 1974) 

COVERD found that insufficient ^ata exist to allow for a 
comprehensive evaluation of vocational education R&D and 
recommended that the Commissioner of Education ensure that USpE * 
develop a cbmpifehensive plan for evaluation of vocational edu- • 
cation R&D. The'objectives of this plan shpuld be determined 
by examining vocational education and its actual benefits- They 
recommended that evaluation crijteria be developed and a sample 
of projects be extensively evaluated. Additional data should 
be collected through longitudinal studies of vocational students 

fnd their efiiployers concerning measures of students; job satis- 
action, continuation of education, job mobility and wages, 
employers* satisfaction, and savings in training costs. The 
Committee also recommended that HEW support a comprehensive, and 
well^integrated information resource system linked to^a dis- 
semination network serving practitionerss ' . - 

The Committee p.ssued a call for the improved evaluation of 
vocational education programs. Larger and better designed 
samples, more appropriate experimental and questionnaire design, 
better measurement of background and criterion variables, and 
more suitable statistical techn:*ques need to be utilized. Other 
measures of program success such as job satisfaction, "job 
turnover rates , changes in student self -perceptions , etc., should 
be considered. In short, vocational education R&D has been 
underutilized due to an inadequate data base and the lack of 
appropriate information collection and retrieval mechanisms. 
(COVERD, 1976) ^ ' ' 

Jennings -and Radcliffe Stress the importance of having 
evidence to show that vocational education is doing a better j^^ob 
than regular cl£Jsses in^ getting people better jobs. They identi- 
fy the following evaluative ^criteria : p^lacement in jobs or close- 
ly related areas for which individual is prepared; whether or 
not the person was well prepared for the .job and satisfied with 
the area for which prepared; and whether the vocational program 
is worthwhile- from the employer's point , of view. (Jennings and 
Radcliffe, 1977) ^ y 

In reporting Congressmen's perceptions of^ vocational educa- « 
tion, Halperin listed one comnionly held feeling that ^'vocational 
education is delinquent in statistigal collection and 'hard-nosed 
program evaluation so that Congress and the taxpayer aannot know 
whether programs are effectivQ or even in proper pompliance with 
federal statutes." (Kalperin, 1978, p. 12) 



Equipment and Facilities . . 

G^rl"teral - Up-to-date equipment and facilities should be 
provided. . , , 

Specific needs: ^(leqislative authority - 1976 Amendments) 

1.. Facilities should be renovated and remodeled to provide 
: vocational education designed to meet today's needs. 

, - It is the pui-pose of this part to provide emergency 
assistance ... to local educational agencies in urban ' 
.and rural' ^areas which are unable to provide vocational^ 
' education designed to meet today ' s' manpower' nee^s due 
■ to 'the age of their vocational education facilities 
or the obsolete nature' o.f the equipment uled for voca- 
tional traini-ng,' in order to assist such agencies in 
, the modernizatioi) of ^facilities and equipment and the 
conversion of academic facilities necessary to assure 
th^t syc;h f^acilities will be able to offer vp'cational 
education piy^grams^-^ich give reasonable promise of 
, employment . .T~^Sec. 191)^ ' 



Other Sources ' • * 

Respondents to Adams' survey ranked "standards/ procedures, 
and funds for replacing obsolete equipnient" as a medium high need. 
A medium priority goal as perceived .by city directors is to im- 
prove the planning and financing of equipment for vocational , 
instruction so up-to-date equipment can be maintained. 
(Adams, 1977) 

^ .. Only two of the 10 state plans reviewed addressed the ques- 
tion of equipment and facilitiesr and these were general statements 
to the effect that up-to-date equipment and facilities should be' 
provided". (State ^lans, 1977) 
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General 
Specific Needs: 



Fuhding 

Adequate Funding should- be provided* 



1 
5 



Funds should be used more^ef f ectively 



Funding levels need to be known * far enough in advance for 
effective planning 

Metho^ds should be established to insure compliance with 
existing regulations in the use of Federal funds • . 



The 1976 Airiendments cpntain a great deal of material on how 
vocational education funds are to be allocated for* various other 
.needs but do not specifically address funding as a need in itself 



Other Sources , • 

A high priority need according to Morrison's respondents vyas 
^financing vocational education programs by effectively using 
local, state, and federal sources • A medium priority need was 
continuing proven innovations when outside funds were no longer ] 
available, (Morrison, 1976) ' , / / * 

NAM found that the relatively high .cost of providing* occupa-- 
tional^ training in such areas as trades and industry binders the 
expansion of these vpcational edyication programs* because funds' 
are usually ^llocatecS on a per .pupil basis. This contributes to • 
the inability of aecfondary vocational education to resp^bnd to job 
market projections for occupationally trained high school students 
(KAM, 1975) 

^District level personnel fe-lt the highest ranked needs for 
vocational 'education in large cities "Werq related 'to funding* 
The top need was for firm commitment^ concerning timely vocational 
funding so' lx:)cal districts could plan and initiate programs on * 
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schedule. The second highest need was seen as district forward 
funding based on long-range plans so as to permit continuity . of 
program. planning and services. Another moderately high- ranked 
need was fjor direct ^federal funding to major urban areas without 
their being denied stat-e funding. Other needs included resource 
allocation" formulas allowing for differences in the cost of deliv- 
ering • vocational education in urban and rural areas, and develop- 
ment of alternative bases for obtaining funds at the local level. 
(Adams, 1977) 

Most of the ten state plans reviewed which mentioned funding 
did so in a general sense by citing a need for adequate funding. 
Some specific needs which were reported included funding for 
innovative programs and "seed money" for the implementation of 
newly developed and tested programs. A few plans called for 
using funds more effectively, especially at the postsecondary 
level. (State Plans, 1977) • . 

The GAO report recommended that the Secretary of HEW should: 

analyze actual State practices in distribution of 
federal funds to determine consistency with the 
\ law's criteria. (p. 104) 

i ■ 

perform tollow^up review^ to insure that States 
improve their distribution procedures so that ^ 
Federal funds can be better targeted to meet 
needs defined in the law. (p. 104) 

Generally, Jthe GAO found little to insure that funds provided to 
statfes are actually targeted'^'to areas of highest need or to areas 
majtimizing program impact. It felt that states could improve 
their 'distribution practices by allQcatin.g on the basis of: 1) 
mfifnpower needs and job opportunities, ' 2) differences "in yocational 
education needs, 3) relative ability to provide resources, or 
4)' relative costs of single programs ^ersus making funds generally 
available to all LEAs . (Comptroller General of the United States', 
1974) ^ / ^ 

NACVE recognized that a problem exists regarding the target- 
ing of .funds in accordance with priorities stated in the law. It 
cit.ed the wide discretion allowed state »and local administrators 
dn handling federal vocational education funds and the competing 
demands made 'upon those administrators as contpibuting factors to^ 
this problem. The Council stated that ther§, is a need for greater 
OE evaluation of how federal funds are used ^nd stronger federal 
guidahce to insure that priorities qxe met. NACVE recommended 
that HEW undertake a research effort to answer the following 
questions; , 




How much h^s the cost of vocational education per 
student hour in different types of courses risen 
since 1964? 

How does the cost rise in vocational education 
compare with the cost rise in other areas of 
education? 

State 'by state, ^ how have state appropriations for 
vocational education compared Vith federal appro- 
priations? 

What factors seem to account for the difference 
between those states that have continued to 
match annual federal increases and those states 
that have not? ♦ ^ 

State by state, how does the record of appropria- v 
tions for vocational education compare with the 
record of appropriations for secondary education? 
For higher education? 

What factors seem to account^ for the difference 
between states which have increased the vocational % 
education appropriation at a greater rate than the 
general education appropriation and states in 
which the opposite is the case? (p, 4) * 

'Generally, the report called for stricter federal guidelines for 
expenditures for certain subpopulations , such as the disadvantaged 
and handicapped, and additional research to evaluate the strengths 
and weaknesses of the current system' in maximizing the impact of 
fede'ral funds. (NACVE, 1975) 

Most of the state councils stated that better regulations 
are needed to define those in need and how to reach* them. Con- 
currently, increased funding for special populations was seen as 
a necessity if the intent of the law is to be met. The councils 
expressed concern over the timing of funding/ requesting that 
funding information be known far enough in a^ance to allow for 
sufficient planning. Councils also urged continuation of a carry- 
over provision. (NACVp, SACVE , 1974) 

COVERD recominended that fifty percent of all vocational 
R&D funds should be designated as Commrissioner ' s funds and be 
used to solve hational or multi-state problems. They also •recom- 
mended that at least twenty percent of the vocational education 
R&D funds be used to generate new knowledge. Generally, a 
better mix of funding procedures was suggested, one which would 
separate funding for career education and vocational education 
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R&D and would insure the allocation of funds specifically to 
Research Coordinating Units. Additionally, the Committee recom- ' 
mended that the Coimnissioners of Educatic^n should fund studies 
reflecting the needs 'of users of R & D to determine the most 
effective dissemination methods and forms of information analysis 
for different situations and users. (COVERD,. ^.976) 

Jennings and Radgliffe mention the Congressional feeling 
that any research funds must be used only for applied research. 
Congress intends that research efforts should offer reasonable 
probability of improving teaching techniques or generating curri- 
culum materials within^five years of their termination. Jennings, 
and Radclif fe also offer the hope that more adequate notice of 
appropriation levels will be forthcoming. (Jennings and Radclif fe, 
1977) 

Halperin reported that the new Administration would like to 
^ relax rigid fiscal controls upon states reaching a specified 

level of performance. He also reiterated the necessity of broad 
categorical programs for advancing the welfare of various groups 
which are inadequately served at the state and local level, while 
at the same time proposing that excessive categorization can be 
reduced. A complaint voiced by Congressmen is that vocational 
> education is dominated by rural, vocational agricultural interests 
and consistently shortdhajiges the cities. (Halperin, 1978) 



- . Interaction With Employers 

General - There should be more interaction and involvement 
o*f employers in vocational ^ducation (legislative authority - 
1976 Amendments) \ . ^ 

Funds available to the States ... may be used for 
contacts t for the support of exemplary and innovative 
programs, including - ... programs and projects to 
facilitate the participation of employers and labor 
organizations in postsecondary vocational education. 
(Sec. 132 (a) (5) (B) 

Specific needs: (legislative authority - 1976 Amendmentsi ' 

1. Wider u§£;— ©^f cooperative vocational eduqation programs 

Funds available to the States under Section 120 may be 
used for establishing or expanding cooperative voca- 
tional educa'tion programs through local educational 
agencies with the participation of public and private 
employers. (Sec. 122) 
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2, Wider use of work study programs^ 

Funds available to the States under section 120 may 
be used for grants to local educational agencies for 
work-study programs . . . {Sec. 121. (a) ) i 

3. Greater coordination and cooperation " with lah<?runions to 
develop pre- apprentice and journeyman training programs 

Funds available to the States ... may be used for 
contracts, .. . for the support of exemplary and 
innovative programs, including - ... programs and 
projects to facilitate the participation of employers 
and labor organizations in postsecondary vocational 
education. (Sec. 132 (a) (5) (B) 



Other Sources * ^ 

♦ 

The two highest priority needs for vocational education, 
according to Morrison's respondents, related to interaction with 
employers and labor organizations. The number one priority need 
was to increase collaboration with key segments of the employment 
community (e.g. business, industry, organized labor, government). 
A medium priority need was that of expanding opportunities for 
all students to explore and practice job skills in both community 
and school settings. (Morrison, 1976) 

« 

NAM found that the limited business and industry involvement 
was a major contributor to the failure of vocational education to 
meet the occupational need? of the student and society^ They 
recommended that cooperative • programs should be expanded even 
when this requires modification of existing statutes. (NAM, 197^) 

Maintaining vocational education programs as a source of 
employees for business and industry was considered as a medium 
need by district level personnel in large cities. Frequent and 
consistent communication with employers to provide information 
on , the programs offered, services provided, and employees avail- 
able through vocational education programs was seen as a lower 
need. (Adams, 19 77) 

Ellis reported vocational education has greatly improved its 
relationships with the employment community since the enactment 
of the 1968 Amendments. National and Stat^' Advisory^ Councils and 
advisory committees have contributed to this improvement. Ellis 
stated that there remains a need for expanded cooperative and 
work-study programs because enrollments are so limited. (Ellis, 
1975) 



J 



Of the ten 'State plans reviewed, the few that mentioned 
interaction with employers ' and labor organizations dealt primaril;* 
with the need to make wider use of cooperative and work^tudy pro- I 
grams • One state plan "mentions better coordination with labor, y 
unions in developing pre-apprentice and apprentice programs, y) 
while another mentioned cooperative programs emphasizing' career ( 
exploration. (State Plans, 1977) ^ ( 

The GAG report claimed that local vocational ' of ficials have 
only informal and infrequent contact with the business community 
andtthat labor resistance was an obstacle to establishing work 
'Stations for vocational training programs* A need for more work 
experience was also reported! Cooperative arrangements between 
schools and employers were encouraged, A recommendation was made 
to the Secretary Of HEW that legislative provisions which inhibit 
the interaction of student^ with the adult world be reviewed and 
possibly revised. (Comptroller General of the United States, 
1974) 

NACVE reported 'that work experience is only one technique 
to be used in the training of students. They cautioned against 
ignoring potential pitfalls - state of the economy, tightness 
of labo*"^arket , saturation of an area or industry with students, 
inadequate supervision, exploitation, misunderstandings with 
labo;: unions, etc. The Council suggested that cooperative work 
experience must be carefully planned, supervised by a knowledge- , 
able coordinator, and details must be successfully negotiated 
witfi employers and labor unions . ^ (NACVE ,^ 1975) 




COVERD,. in reviewing literature on instructional techniques, 
.ioted that there is limited evidence demons.trating the superiority 
^f coopera^tive educatioh programs over oth^r methods of instruc-- 
' *tion. In citing an assessment of research in cooperative voca- 
tional education methods by Wallace, they reported there ^is a 
need for: (1) a theo'retical f ^ameworfe* to guide the research and 
application of research findings; improved., research techno- 

logy for evaluation of such complex instruction ; (3) attention 
to many s^udentv and teacher variables and their interactions in 
complex learnihg environments; and (4) greater attention "1:0 
growth in students', related to Intellectual skills, social skills, 
^ attitudes toward educaticxi and the world of work, and self 
concept. 

The Committee also examined studies which have been conduc- 
ted regarding the effectiveness of job training in industry and 
concluded that very little is known about tasks which are taught' 
most effectively on the job or in school. (COVERD, 1976) 
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^ Pg^sonnel Development 

General - The qualifications of persons working or pre- 
paring to work in vocational education .should be improved, 
(legislative authority - 19^6 Amendments) 

Funds available to the States under Cection'^iaO (a) 
may be used to support . programs or projects designed 
to improve the qualifications of persons serving or 
preparing to serve in vocational education; programs r 
^ including teachers, administrators, supervisors, and' 
vocational guidance and counseling personnel, 
{Sec. 135 (a) 

Specific needs: (legislative authority - 197C Amendments) , 

1. M0re women and ethnic group members should be prepared to 
administer vocational education prograrrs. 

2, There should be more effective preparation for special areas 
of vocational education 

Funds available to the States under Section 130 (a) may 
^ be used to support programs- or projects ... ^ 

(1) to train or retrain teachers, and supervisors . 
and trainers of teachers , ^in vocational education 
in new and emerging occupations; 

(2) which provide inTservice training for vocational 
education teachers and other staff members, to im- ^ 

'prove the quality of instruction, supervision, and 
administration of vocational education programs, and 
to overcome sex bias in vocational education programs; 

(3) whiclf provide for exchange of vocational education 
teachers and other personnel with skilled workers or 
supervisors in business, industry, and agriculture 
and for development and operation of cooperative 
programs involving periods of'^eaching in schools 
providing vocational education anc of experience in 
commercial, indijjstrial , or other public employment 
related to the subject matter taught in such school; 

(4) to prepare journeymen in the sk^^lled trades or 
occupations for teaching positions; 

(5) to train and to provide in-service -training for 
teachers and supervisors and trainers of teachers in 
vocational education to improve the quality of' 
instruction, supervision, and acrr.inistration of 

t vocational education for persons with limited English- 

speaking ability and to train or retrain counseling 
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and guidance personnel to meet the special needs 
of persons with limited English-speaking ability 
.... (Sec. 135 (a) (1-5) 

Funds available to the States^ under Section 130 (a) may 
be used for contracts for t*^ support of curriculum 
development projects, including . . • 

support sejrvices designed to enable teachers to meet 
the needs of individuals enrolled in vocational 
education programs traditionally limited to members 
of the opposite sex, ... (Sec. 133 (a) (2)) 

Nfot less 'than 20 per centem of the funds available to 
the States under Section 130 (a) shall be used to 
support program.s fot vocational development guidance 
and counseling programs and services which . . . shall 
include — . . . , ' ' _ 

vocational guidance and counseling training designed 
to acquaint guidance counselors with (A) the chang- 
ing 4^;'ork patterns of women, (B) ways of effectively 
overcoming occupatioiikl sex stereotyping, and - (C) 
-ways of '^assisting girls and women in selecting careers 

* solely on their occupational needs and ijitere'sts, 
and to. develop improved career counseling materials 

^ which are free; (Sec, 134 (a) (4) ' , 

Ot her Sources < 

— • ■ — m 

Three ^iieeds related to personnel de\?elopment received high 
priority rating by Morrison's respondents: improving opportuni-- 
ties for the in-service training of vocational personnel to renew 
and expand their competencies; insuring that preservice prepara- 
tion of vocational personnel meets present and emerging compete 
ency^needs; and improving counselor education programs. Lower 
priority needs included: pxeparing an adequate supply of quali- 
fied vocational personnel for each leadership role; identifying 
and improving the special skills needed by vocational personnel 
to work with special groups; and providing specialized personnel 
to \jQcational programs. (Morrison, 1976) 
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Among the hi ghest ranked ten specific needs TDr vocational 
education in large cities was developing effective preservice 
counselor education programs in vocational guidance. Oi:her fair- 
ly high ranked needs were training vocational teachers and 
counselors in new approaches to vocational education and encour- 
aging the involvement of teachers in industry-based exploration 
and in-service education. A medium need was that of developing 
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the special awareness, instructional skills 
needed to serve the handicapped^ minorities 
needs groups, (Adgims, 1977) 

Ellis reported that the Education Trofessions Developnient 
Act has made significant strides in prej-arinr- vocational educa- 
tion leaders of vocational education, Lven though the absolute 
nuirJDer of vocational education teachers has rrown, Ellis noted 
txiat there are critical shortages in selectee vocational fields, 
particularly agriculture and trade and industry. (Ellis, 1975) 

All ten of the state plans mentionecV the" "need for improvinc 
the qualifications of persons working or prcf^aring to work in 
vocational education^ most crucially in sjvecial needs areas, ^ 
iJeeded personnel development projects incluccci programs fbr (1) 
\7orking with the handicapped, (2) traininc Gtate staffs to recoi" - 
nizG and overcome sex bias, (3) training in new and emerging 
occupations, (4) training consumer and homer^aking personnel, 
(5) training administrators .of apprentice training, (6) improv-- 
ing the qualifications of guidance and counseling personnel, 
(7) educating instructional, supervisory, coordinating and admiir 
istratiVe staffs in work-experience procrerc, (8) inservice 
training in competency-based instruction for all vocational 
teachers, and (9) preparing personnel to effectively organize 
and operate student vocational organizations/ (State Plans, 1977) 

COVERD recommended that the Commissioner of Education and 
state directors of vocational - education insure that researchers 
and administrators from minority populations be involved in R & D 
programs. It was also, suggested that annual status reports be 
prepared on the percentage of R & D project directors who ar^ 
members of various population "subgroups . The Committee recomme 
ded that user training programs be conductec involving R&D 
personnel, administrators, and educators to improve the flow 
information from the R Sr D resource syster to the f)ra^tice * 
con'jnunity • (COVERD, 19 76) 

> 

Jennings and Radcliffe stated that Congress, in modifying 
the EPDA Program, was trying to attract people who have skills 
^ that need to be taught and to assist ther in moving into the 
vocational education profession. The nev7 pfoaram will also per- 
mit teachers certified', in over^suppliec fielf.s to be retrained 
for positions in vocational education. This v/ill help address 
the teacheX supply imbalance that exists in rjome areas* (Jenninrs 
and Radcliffe, 1977) 

Halperin reportod that Congressmen are critical of vocational 
education for being run by "an encrusted, cefensive, unprogress ive 
educational establishment, unwilling to coo^'oratG with society's 
other trainers for employment. • Vocational ec'.uc^ition faculty 
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don't keep up-to-date and think ... only about their own voca- 
tion." (p. 11) Halperin advocates research activities designed 
to dispel such views. (Halperin, 1978) 



Planning 

General - There should be more and improved planning to guide 
the development and administration of vocational education 
(legislative authority - 1976 Amendments) 

Any State desiring to receive' Funds ;inder this Act 
shall submit to the Commissioner, durijjg Fiscal year . 
1977 and- during each fifth fiscal yepx occurring there- 
after, a State plan for vocational education for the five 
fiscal years succeeding each such fiscal year. (Sec. 
10> (a) (D) • . 

Any Stat^ desiring to receive funds under this Act shall 
submit to the Commissioner an annual program plan and 
accountability report for each of the fiscal years in- 
cluded in the five-year State plan. (Sec. 108 (a) (1)) 

Funds reserved to the Commissioner under Section 103 
for programs under this part shall be used primarily 

for contracts, ^nd in some cases for grants, for- 

support of a national center for research in vocational 

education, and shall, either dijrectly or through 

other public agencies develop and provide information 

to facilitate national planning and policy I development 
in vocational education; (Sec- 171 (a) (2) (D) ) 

Specific needs: 

To avoid duplication of effort, vocational education planners 
should be aware of all traioing facilities and programs 
in their geographic areas. 

Other Sources 

Planning, per se , was not listed as a separate need, 
and planning related concerrts were not viewed as being high 
needs for vocational education in large cities. The need for 
systematic procedures for using follow-up information to improve 
the educational process received a mean rank of 42 out of 50. 
(Adams, 1977) 
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Ellis' examination of annual and long-range plans for ^ 
vocational education indicated an improvement in the states' 
abilities to engage in comprehensive planning, but noted that 
problems exist. Numerous pieces of federal and state legisla- 
tion calling for comprehensive planning lead to overlap^ 
d-uplication , and sometimes competition among various agencies 
to serve the same people. Ellis reported that while the 
Vocational Education Amendments of 1968 called for planning, 
there was neither a specific mandate nor specific appropriation 
for states to engage in comprehensive planning. (Ellis, 1975) 

Jj alf of the ten state plans mentioned planning concerns, 
generally citing the need for more and improved planning to 
auide the development and administration o^f vocational educa- 
tion. Specific needs included planning for special* needs 
students and planning that reflects the utilization of labor 
market needs data, training resources available, and advisory 
councils. 

The GAO report noted that the vocational education p'lanning 
process could be improved. It found- that state and local plans 
for vocational education were primarily compliance documents, 
neither providing direction to programs nor measuring their 
impact. ^The needs of potential students and communities were 
not being assessed in any systematic, ongoing manner. It also 
found that the limitations on advisory councils lessened their 
impact on improvement in the planning process and that or- 
ganizational patterns within vocational education fragmented 
responsibility, ro^ulting in independent and isolated pla^ining. 
The report made ^^»umber of recgmmendations relative to 
planning: 

1. The Secretary of HEW should help states develop an 
'approach to planning which will better meet state needs 
as well ^*Ss provide information necessary to more ef- 
fectively monitor and evaluate federal program ex- 

, penditures - 

2. Efforts should be expanded to enforce the requirement 
that all LEAs and SEAs , in planning vocational" programs 
identify the needs of public and private business, 
industry^ labor, and students and f ur thejrmore , that 
those needs be considered the primary basis for 
decision making about providing vocational services 
under tke Vocational Education Act of 196 3 . 

3. The roles of those organizations within HEW involved in 
occupa ti Glial training should bo clarified and some 
mechanism shpuld be implemented by which these bodies 
can engage in coordinated, comprehensive planning. 
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4. States and LEAs should be encouraged to 

assess training resources and facilities in all 
geographic areas -so federal funding can be viewed 
within th-B context of total available resources. 

In its recommendation to Congress, the GAO asked Congress 
to consider requiring the Secretaries of HEW and DOL to 
coordinate the planning of thosf programs conducted under 
state plans for vocational education with the planning done 
for training programs under CETA and those lander the State 
Postsecondary Commissions authorized by the educational amend- 
ments of 1972. This coordination would assure that education 
and manpower efforts were synchronized ■ at all levels. 

NACVE acknowledged the compliance nature of most state 
plans, but asserted that allN states are concerned with seeking 
ways to improve their planning process. The Council cited 
two efforts where state councils have recommended to the state 
board of education that the vocational education delivery system 
establisb statewide priorities, goals,, and objectives based on 
input received from a task force- representing (1) all levels of 
^vocational education, (2) public and private agencies serving 
vocational education,^ (3) lay persons, ai)d' (4) students; the 
state councils also recommended that the \system provide for 
continuous review, updating, and evaluation. While it appeared 
to the Council that some progress was being made in assess-ing 
needs, setting p^riorities , and planning resource use, the 
Council recommended that a thorough needs assessment be required 
in each state before expenditure' j>riorities are set so that the 
needs of the le&i~vocal or less powerful elements of the popula- 
tion are not ignored. (NACVE, 19 75) 

The joint NACVE-SACVE report recognized current limita- 
tion$ of state plans, especially their compliance nature, and 
stated that the documents need to become more effective guides 
for performance.. Unfortunately, the councils concluded that a 
"system has not been developed- which will bring about 'the ihost 
effective planning at the state level." Suggestions for improving 
state plans included increasing the flexibility of th£_jegula- 
tions defining how the state plans are to be created, anS 
eliminating unnecessary formal requirement's. (NACVE, SACVE 
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Halper in reported that one of the recent congressional 
criticisms of vocational education has been that vocational 
education refuses to engage in effective' statewide planning 
so that a state's needs and resources^ might be better matched. 
(Halperin',. 1978) 

Research' and Development • ^ 

General -R&D should be"^^^pported to encourage' the improve* 
ment and Responsiveness of vocational education, (legislative 
authority - 1976 Amendments) - . 

Funds ^available to the States under Section 130- (a) may 
be "used fort support of State research coordination" units 
and for contracts by those "units pursuant to comprehensive 
plans for program improvement involvinnig ~ (1) applied 

research and development in vocational education; (Sec. v 
131 (a) (1)) one other reference * 

Grants and contracts under Section 188 may be used, in 
accordance with applications appro\)red under Section 189B 
for - ... (3) experiment al / developmentail , and pilot 
programs and projects designed to test the effects of 
research findings; (Sec. 189 (3)) 

Specific needs: (legislative authority - 1976 Amendments) 
1) Dissem4.nation and utilization - there should be greater 
knolwedge about and use of research results. 

Funds available to the states Under Section 130 (a) may 
be uBed for support of state research coordination units 
and for contracts by those units pursuant to comprehensive 
plans of program improvement involving - ... (5) dissemination 
of the results of the contracts made pursuant to paragraphs 
(i) through (4) ^ ^Including employment o^ persons to act 
as disseminators, oh a local level, ^Df these results. 
(Sec. 131 (a) (5)) J 

Grants and cor;itracts under Section 188 may be used^ 
in accordance with applications approved under Section 
189B, for ...■•(4) other demons\trat ion and dissemination 
projects. (Sec. 189 (4)) \ 
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other Sources •■ v 

Morrison' s respondents felt it a high fJ^ority need to 
provide tools and techniques for improved planning, management, 
and evaluation of vocational education program!^. Low priority 
•needs included improving the effectiveness with which program 
(idrectors adopt, valid innovations and develop effective or- 
ganizational pattern-s. ([Morrison, "1976) 

■ ^District level vocational educational personnel in large 
cities perceived, as. a medium high need, the development of 
procedures for' incorporat4ng> demonstrated innovations .into the 
operating school district when outside funds are no Ibhger 
available. Identifying methods for diagnosing the basic academic 
competencies of students so ^that appropriate remedial activities- 
can be prescribQjd was considered to be a medium low need. 
(Adams., 1977)/ >t ' 

Ellis reported that- Congressional appropriations for 
vocational- education R&D ha,ve consistently fallen short of ; the 
authorized le^l. . This 'underfunding has led to several serious 
needs in vocational education , among them the need for (1) 

. more definitive data to determine the impaot' of ^vocational educa- 
tion on the* national program, (2) basic as well as applied re- 
search, (3) more coordination among projects of national need 

. so as to avoid duplication, ' (4) ongoing addressing of Hiati'onal 
and state priorities, and (5) increased emphasis on the utiliza- 
tion and dissemination of research findings. (Ellis 1975) 

Most .©f "th'e ten state plans supported R & D so' as to encour- 
age the improvem^t and responsiveness of vocational education. 
Some of the specific R & D activities which were called for 
included: developing a system for surveying employers of persons 
who recently completed vocational progr'ams, developing a regional 
system for identifying and serving the vocational needs of adults,' 
anc implementing programs to test the effectiveness of research 
•findings. (State Plans, 1977) , . « 

COVERD , recommended that a significant portion of Federal 
R&D funds ' should, be designated for dissemination and utilization 
under the direct responsiblity of the Bureau of Occupational _ and 
Adult Education of USOE. . It asked that comprehensive dissemina- 
tion and utilization plans be developed and user training programs 
be conducted to" improve the flow of information from the resource 
.'system to practi^tioners . ^The Committee recommended several stra- 
teg-ies necessary for a comprehensive evaluation of vocational 
education. R & D: (1) defining the goal's of the R&D program, 
(2) having funding agencies provide access to final reports" of 
all R&D projects, ( 3) ' facilitating the development research 
synthesis documents, (4) developing an* evaluation plan for R'& D 



that includes" the collection 'of .longitudinal data, and (5) 
developing a comparative, evaluative data base to determine what 
vocational education -progr^S and R&D have b^en effective and 
should . receive continued support. (COVERD., 1376) 
♦ , " • • 

' The National and State Councils asked how research and 

exemplary programs can ,b6 designed so as to i. 've maximum impact 
on the vocational education system? . In "4 sur\ y of impact . 
directed to State Councils,' a question* relative -to R '& D was, "Is 
' there an adequate system for the dissemination of t-he/restilts of 
research and exemplary programs' in your Stated" - Of the 36 ^ates 
responding, nineteen answe2;ed- "yes" and seventeen ' "no" . (NACVE, 
SACVE, 1974, Appendix 11, p. 13) 

, Jennings -and Radcliffe reported "Congress ' intent to see 
results 'from Vocational Education R&D. -By forcing states to 
contract for research, curriculum development, or exemplary pro-; 
gram,_ rather than make grants for -these activities . Congress 
hopefe to see more concrete results. Congress feels that voca- 
tional education research should ha^e a direct impact on class-^ 
. room teaching techniques or curriculum materials. (Jennings and 
. Radcliffq,. 1977) ; . " 



Sex Discrimination and Sex Stereotyping/Equal Opportunity 

General - All artificial barriers to participation in 
vocational programs should be eliminated. (legislative authority 
•- 1976 Amendments) ' * • 

It is the' purpose of' this p^rt 'to assist . states in ^ ^ 
improving planning in the. -use of all resources avail- 
able to^them for vocational education ... It is also 
- ' the purpose of this part to . autho^-ize Federal grants . 
. to States ^to assist thelt^ . . (3) to develSop and carry 
out such programs o£ vocational education within each 
state so as to overcome sex' discrimination and sex 
stereotyping in vocational prcigrams (including pro- 
grams of homemaking) and thereby furnish equal educa- 
tional opportunities in vocational education to -persons 
o^ both sexes " (Sec. 101 (3)) 

Funds available to the states under Section 130 (a) may 
be- used to support activities which show promise of 
overcoming sex stereotyping and bias in vocational 
education. (Sec* 136) 
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Gpecific needs: . * . 

1. Sex discrimination and sex stereotyping should be overcome 
in vocational education programs. ' < 

2. No one should be prevented from taking vocational courses 
on the iDasis of r&ce, ethnicity, or cultural origins> 

r 

Other Sources ' ■ 

Those responding to the National Survey of Vocational Educa- 
tion Needs gave a low priority ranking to the need to 'enroll 
students into all voca't ion programs on an equal opportunity basis. 
Based upon a 'means ranking, ^he statement was ranked number 47 
out of 48. ■ (Morrison, 1976-} 

4. 

Nine- out of the ten state plans reviewed listed the elimin- 
ation df sex stereotyping and sex discrimination as a goal or 
-objective, ^although several states reported that during the public 
hearings, several citizens said, that too much emphasis was bei'nq 
placed on sex disctimination . ' ' 

The GAO report determined that sex discrimination was among 
the barriers which have restricted access to training and employ- 
ment. Although prohibited by Title IX of the Education Amendments 
of 1972, sex discrimination was found to be implicit in catalogs ' 
descf ibing vocational programs and in the location, of c|asses in 
such a manner 'as to encourage sex role stereotyping. gS recom- 
memded to the Secretary of HEW that applicable provisions of 
T'itle IX of the Education Amendments of 1972 be implemented to 
eliminate sex discrimination in vocational education, and that 
proven techniques be adopted tcT recruit members df one sex into 
occupations traditionally considered the prerogative o.f the other 
sex. Thei^4l so recommended that entrance reauirements to insti- 
tutions and course^' be analyzed and that stages be advised thai 
federal funds will not be available for programs which Unfairly 
deny entrance to students who want training. 

^ The Rational , and 'State Advisory Councils argued that in 
order for vocation^al education to continue to grow and meet the 
needs of people, it will have" to determine whether discrimination 
based on race or bex exists. (NACVE, SACVE,'-1974 ) 

The COVERD reported that although vocational education has 
been encouraged to eliminate sex stereotyping in programs and to 
provide equal access to programs associated with occupations 
traditionally dominated by one sex, it is not clear to what extent 
this requirement is being met. The Committer, noted a dearthiof 
vocational education R&D funding devoted to the needs of w|men, 



especially since more than half of the students in vocational 
education are women. (COVgRD) , 1976) 

. Radcliffe asserted that vocational education has, a tremen- 
dous responsibility in overcoming sex discrimination and providin 
for productive employment, '{Jennings and Radcliffe, 19^11) 

Halperin noted the following Congressional crit:Nfism of 
vocational education : "vocational -education (and home economics 
in particular) is discriminatory toward women, minorities and 
the handicapped and much of vocational education is sex^stereo- 
typed." (Halperin, ^1978, p. 11) 

# 

Special Needs Groups ' 

General - Appropriate vocational education prograrms should 
be provided for individuals Who require special programs, modifi- 
cations of programs, or supplemental services to help them succee 

Specific groups : (legislative authority - 1976 Amendments ) 

1, Handicapped - Mental, hearing, deaf', speech impaired, 
visually handicapped, seriously emotionally disturbed, 
crippled, or other health impaired. 

For each fiscal year, at least 10 per centum of leach 
State's allotment under Section 103 shall be used to 
pay 50 per centum of the* cost of vocational education 
for handicapped persons. (Sec. 110 (a) ' . . , 

■ ■ .' • ■ ' ■ »' 

2. Disadvantaged - Persons with academic or economic problems 

Any State desiring to .receive the '^amount for which' it 
* is eligible for any fiscal year pursuant to this Act " 

shall, through its State beared, submit to, and maintain 
on file with, the Commissioner a general application 
p^roviding assurances,- ... that the State shall, in 
considering the approval of such, applications, give 
priority to those applicants which - are located in 
Gcanomically depressed areas and areas with high rates 
of :unemployineri,t, and* are unable to provide the resources 
n^^cessary to mept the vocational education needs of 
those areas without Federal assistance, ... (Sec. 106 
(a) (5) (A) (i)) 

/" 

From the sums made available for grants under this 
subpart pursuant to sections 102 and 103, "the 
*Commi§s_ioner is authorized to make grants to States 
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■to assist them in conducting special programs for 
the disadvantaged ... (Sec. 140) 
ences 

* 

3. Bilingual .- Persons with limited English speaking ability 

Funds available to the States under se.ction 130 (a) 
may be used for contracts, as part of 'the comprehensive 
plans of program improvement mentioned in, section 131 
(a) for the support of exemplary and innovative pro- 
grams, including - ... programs of effeqtive vocational 
. education for individuals with limited lEnglish-speaking 
ability; (Sec. 132 (a) (3)) 

4. Inmates of correctional institutions 

, Women* , 

Grants to States uhdcr this subpart may be used^ in 
accordance with five-yeat State plans and annual 
program plans approved pursuant to section 109, for 
the following purposes: ... support services for 
women ^who enter programs designed to prepare indivi- 
■ duals for employment in jobs which have been tradi- * * 
tionally limited .to men, including counseling as to 
the nature of such pMDgrams and the difficulties 
which may be encountered by women in such programs, 
and job development and job follow--up services; 
(Sec. 120 (b) (1) (J) ) 

6. Other 

Grants to States under this subpart may be , used, 
for the following purposes: ... day care services 
for children of students in secondary and post^ 
secondary vocational education programs; (Sec. 120 
(s) (10) (K)) - • ' 

Grants to States unde^:;:^his subpart may be used..,, 
for the followincj purposes: ... vocational education 
for - (i) persons who had solely been homem'akers but 
who now, because of dissolution of marriage, must 
seek employment; (ii) persons who are single heads 
of households and who lack adequate job skills; (iii) 
persons who are currently homemakers" and parttime 
workers but who wish to Secure a fulltime job; 
(Sec. 120 (b) (1) (L) (i-iii)) 
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other Sources 



Generally, Morrison's respondents ranked special needs groups 
as low priority. Two exceptions were improving and expanding 
vocational education to meet the needs of the handicapped, which 
•was ranked as a high priorii*^ need, and iirproving and expanding 
vocational education to meet the needs of the disadvantaged which 
was a medium. priority need. (Morrison^ 1976) 

I, 

NAM reported that the national dropout rate in secondary 
vocational education programs Was considerably higher than that 
for nonvocational education programs , primarily because many 
vocational education students arc from - social ly , economically, 
and intellectually disadvantaged backgrounds and thus have spe- 
cial needs. Very few programs are designed specifically for this 
group and only a small percentage of those p:f*ograms have been 
shown to be successful in reducing the number of dropouts and 

meeting the special needs of the disadvantaged, (NAM, 1975) 

<^ - . 

A medium need for vocational education in large cities as 
perceived by district level personnel was developing ' the special 
awareness, instructional skills, and service skills required to 
serve the handicapped and other special needs groups. Vocational 
education programs for early school leavers and unemployed youth, 
and remedial basic skill programs for students with weak academic 
skills were viewed as low need areas • (Adams, 1977) 

Vocational education enrollments by the socio-economically 
disadvantaged and by the handicapped showed an increase (in terms, 
of absolute numbers) during' the period 1971-1974. Ellis reported, 
however, that educational services to"^s"pecial needs persons have 
not grown tp the extent anticipated, both because disadvantaged- 
or handicapped Vocational education students do not qualify for 
concurrent financial assistai:ice or Stipends and the definitions 
for "socio-economically disadvantaged" £jnd "handicapped" need 
clarification- Once those definitions are clarified, those who 
may best benefit from vocational education programs and services 
can be identified and recruited. Ellis added that the problems 
associated with providing vocational education services to persons 
with special needs are even more severe in the corQ cities. She 
stated that hard data portraying the extent ta, which vocational 
education programs are having an impact on alleviating the pro- 
blems of students in core city schools would be useful. (Ellis, 
1975) * . - 

All ten state plans made extensive reference .to special needs 
groups including: homemakers seeking employment; enrol lees i-n^ 
non-tradi tional programs ; adult hand i capped persons ; the disad- 
vantaged; the handicapped; persons with limited English^-speaking 
ability; dropouts and potential ^ dropouts ; youthful offenders; 
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gifted and talented individuals*; and students who are parents. 
Some of the perceived needs expressed in the plans included 
improving and/or specializing curriculum, offering more adult anc 
postsecondairy programs for handicapped individuals, provid^^ng 
support service^ for women, establishing day care services for 
the children of parents who, would otherwise not attend^ and pro- 
viding programs for youthful offenders and those of limited. 
English-speaking ability. (State Plans/ 1977) 

The GAO report indicated that persons with special needs 
have not been given as high a priority as was intended under the 
196"^ Amendments, a conclusion based upon an analysis of expendi- . 
tures for the disadvantaged and handicapped in relation to each 
state's total expenditures for each fiscal year from 1970 through 
1973. In addition, GAO found that relatively few handicapped 
individuals wdre participating in vocational education programs. 
State q.puhcils, too, have expressed concern about the small per- 
centage of disadvantaged and handicappec^. students being served 
relative to the number needing vocational education. ' GAO recom- 
mendations to the Congress regarding programs and services for 
the disadvantaged and handicapped took, the form o£ t^o options: 

a) Requiring states to match Federal set-asidafe for 
disadvahtaged and handicapped at the salltte— aevel 
they are required to match regular part B funds 
(50-50) , thereby insuring state\and local involve- 
ment in ^nd commitment to -these e^^t^rts.. 



' or • 

b) Increasing the per'centatge of the set-asides for 
the special need categories* (p. 21) 
(Comptroller General of the United States, 1974) 

■ ■ * " ■ ' 

The Council acknowledged that disadvantaged and handicapped 
studenis are not being adequately served by vocational education 
programs. It-- points out the tension between federal priorities 
and local concerns which exists in this program area.. With an 
absence of federal pressure to direct funds toward students with 
special needs, funds will probably be diverted into programs with 
more backing from locally powerful groups. The failure to require 
a thorough needs assessment for the deyelopm.ent of" state plans was 
also seen as contributing- tb the problems of the disadvantaged and 
.handicapped. (NACVE, 1975) 

Most of t^e state councils favored maintaining set-^asides 
for the handicapped and disadvantaged, but felt that present fund- 
ing levels were inadequate. Generally, the couTicils felt they 
would need increased funding in order to meet the needs of special 
groups. They also called for standardization in the definitions 
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of disadvantaged and handicapped in various federal laws, and 
better regulations for defining those in need and how best to 
reach them. (NACVE, SACVE, 1974) 

The Committee raised the question of how vocational educa- 
tion can best serve socially and economically disadvantaged 
students. A review of R & D revealed that efforts concerned with 
the disadvantaged have lacked breadth and quality . Topics ^need- 
ing more attention include public school vocational education 
programs, national surveys, teacher preparation, student follow- 
up studies, and structured evaluation. Whether or not vocational 
educat'i^on can be expected to overcome barriers such as language, 
or acculturation difficulties which confront ethnic minor^ities 
is another R&D area which demands attention. (COVERD, 1976) 



• Transition' from School to VJork 

' '-^ ^ 

General - Methods should be i^j^veloped to^elp prepare 
students for job entry. 



Specific needs: (legislative authority - 1976 Amendments) 

^ <• • 

^1. Theire should be in-school prep^jiation for transition: job 
seeMng skills, presenting one *s self in job interviews> 
etc/ * • ' . 

2. Students should be prepared for occupational adaptability 
^nd flexibility. 



Job placement (and follow-through) services should be 
p^rovided. 

Not less. than 20 percentum of the funds available 
to the States under Section 130 (a) shall be. used ' 
to support programs for vocational development 
guidance and counseling programs and* ^services 
which, subject to the provisions of subsection (b) , 
shall include - ... (3.) provision of educational 
and job placement services/ includinn programs to 
prepare individuals for 'prof essiofial occupations 
or occupations requiring a baccalaureate or higher 
degjree^ including follow-up services; (Sec'. 134 
. (a) (3)) 



Other Sources 
— ^ ^ 

Respondents to the National Survey of Vocational Education 
Heeds rated "providing comprehensive vocational guidance, counsel- 
ing, placement, and follow-up services to all who need them" as a 
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high priority need. Based upon the mean group ratings, this need 
was assigned a priority rank of six out of a total of forty-eight 
ranked needs. Needs which were ranked in the medium priority 
category incl/uded: developing alternative n^ethods for assisting 
studer^ts in transition from school to work (e.g., job seeking 
skills/ coping with work entry and adjustment, work habits, atti--- 
tudes) ; and placing vocational students in occupations related to 
their 'education through coordinated efforts at all levels (class- 
room, school, district, state, federal). (Morrison, 1976) 

Creating opportunities for students to develop prbblem-solv-* 
Vng skills 'for coping with work entry and jcJb adjustment problem^, 
and pre-employment job readiness programs to help students learn 
job seeking skills such as job hunting, job interviews , completing 
job applications, -etc., were perceived as medium low' needs by 
district level vocational education personnel in large cities . 
(Adams, 1977) 

Congress envisioned that the 1968 Amendments would help 
alleviate unemployment and poverty by increasing th^ proportion 
of. participants who complete vocational education programs and 
who find appropriate ejnployment. Ellis reported 1;hat the growing 
success of . vocational' education programs and supportive services 
has been reflected in the numbers of completions and placements. 
She posed somfe fundamental questions, however, which remain 
unanswered. /What is happening to students who did not complete ■ 
their programs? Have .the . students who found jobs remained in 
those jobs and if so, have they found satisfaction in their em- 
ployment? f Ellis 'contended that a national follow-up system is 
needed to gauge the effectiveness with which vocational education 
is prepai/ing youth and adults for the labor market. Ellis also 
viewed the development of the cluster concept in curriculum 
design as holding promise for vocational education, although 
limited funding has hampered progress. Ellis stated that workers 
' would be able to transfer more readily from, one job to another 
within a family of occupations if students v;ere able to acquire 
a salable skill in one area while becoming knowledgeable about a 
host of related occupations. (Ellis 1975) 

Of the ten state plans which were reviev^ed , only three 
specifically mentioned the need for methods to be developed to 
help prepare students for job entry. Those three plans addressed 
the need for job placement and follow-up services- (State Plans-, 
1977) 

The GAO report stated that schools have not routinely provided 
job placement assistance, both because many teachers view their 
sole function to bo that of education and training, and because 
noi then, schools nor teachers have generally been held accountable 
for placing students in jobs when they complete that trainino. 
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The report also cited the lack of student and employer follow-up, 
which precludes evaluating state and local vocational programs 
in light of manpower heeds and job opf^ortunities . GAO recommended 
that Congress require that Schools take responsibility for job 
placement assistance and follow-up in federally supported voca- 
tional education programs. {Comptroller General of the United 
.States, 1974) - ^ 

Many state councils reported that it was difficult to 
respond to the question., "Do vocational education students in 
your state find jobs in the area of their training?" because of 
a lack of followup data. Some states questioned evaluating the 
success of a secondary vocational education program solely on the. 
basis of placement in the area of training. They contend that 
many employers value the training vocational education students 
receive in wor3^' attitudes and general work-related skills more 
highly than specific job skills. All councils agreed, however, 
that follow-up (services and rccQrd keeping were desirable, and 
the use of funds for these purposes should be authorized. 
(NACVE, SACVE, 1974) ^ 

COVERD recognized that there haye been many attempts to 
maximize the proportion of vocational education graduates placed 
in jobs. Two strategies which have been used, are labor market 
forecasting and career guidance. The Committee suggested that 
labor market .forecasting methods can be Improved in thrdd ways: 
by attempting to take into account ' the extent to which wages and 
working conditions will change if more or fewer workers are 
trained; by recognizing that labor market information from vari- 
ous vocational education districts must be coordinated in some 
way because workers move from place to place; and by considering 
macro-economic or institutionally oriented employment policies 
when making labor market forecasts.. In reviewing R&D relative 
to occupational adaptability ^j(|the Committe-e noted that because of 
the problems .faced by researchers attempting to study Common re- , 
quirements in existing jobs or to provide preparation for a 
variety of job opportunities , there remains a' need to identify 
similar skilly across groups of occupations and to determine the 
skills required for advancement within occupations, (COVERD, 
19\76) > 



* 



ERIC 



2-50 



^1 



' CHAPTER 3 



BACKGROUND PAPERS FOR SELECTED NEED AREAS 



I ^ This chapter presents th^ background papers prepared by 

consultants knowledgeable in the fiye need areas selected for 
special emphasis. These papers are not specifip research propo- 
sals; they are instead questions and ideas from well informed 
individuals concerning^^i^t is necessary to advance the state of 
knowledge in their par^M^ar content areas. The authors were 
specifically asked, to p^^are "think pieces", not literature 
reviews or synthesis and analysis papers. To facilitate origin- 
ality, they were given complete discretion on how to organiz'e and 
present their ideas. Ip addition, the consultants varied in the 
amount of time' they were able to devote to their tasks. The 
result is a group of papers that vary widely in format, approaches, 
issues, and deptl;i. Because of this variety, the reading may be 
somewhat difficult, but most\ of the papers succeed in raising 
questions worthy of attention. 

The need areas vary widely; there are therefore few themes 
cominon to the papers. One of the few recurrent ±hemes , however, • 
is that more attention should be paid to the basic concepts 'that 
underlie the field. Often the research agenda set for vocational 
education, both in the priorities of the USOE and state RCUs , has 
been ^ddressed to immediate, practical problems. The nature of 
these problems and the time frame- in which they have ha^ to be 
addressed - and reports be produced - have precluded careful 
attention to conceptualization or even to adequate Instrument 
development. Vocational researchers have often had to try to 
solve immediate problems without being sure that the problem was 
correctly stated or their tools adequate t9 the task. 

Knaak's paper is a good example of the kinds of problems 
encountered when problem-solving is not accompanied by more fund- 
amental research. Knaak examines the costs and effectiveness of 
/ competency-based vocational education and raises questions which 

often»have not been addressed in the efforts to develop and imple- 
ment competency-based .curriculum. 

Kruger's paper oh coordination and articulation gives another 
example of the need to examine basic premises before trying to 
determine how something can be done better. There is currently 
f a major federal initiative to improve coordination between voca- . 
tional education and CETA. Kruger raises -some general questions 
abojat coordination that are directly applicable to th\is area. 

3-1 
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For example: what is the definition of coordination, what are -its 
objectives, and why are. these important? What will vocation^^l 
education and other agencies gain and lose from coordination? 
V7ho will be responsible for coordination and what does each party 
give and receive in return? These are the kinds^ of basic ques- 
tions whi:ch are essential- to ^fully understanding problems but 
which, unfortunately, are often overlooked or gi-ven short shrift 
wheo the focus is primarily on solving a particular problem. In 
the following section the m^in points of each of the individual 
papers are summarized and the original papers arc then presented 
by need areas. 

Coordination ^ 

Howard Johnson's and Daniel " Kruger ' s papers explore in con- 
siderable depth the internal and external ramifications of arti- 
culation and coordination. Johnson concentrates on internal 
aspects , particularly on vertical articulation across sequential 
competency levels,. The goal of articulat;ion , for Johnson/ is to 
assure continuous progress for students . To help assure such 
progress, Johnson identifies thi*ee broad categories of concerns 
to which • articulation R&D could be directed: (1) understanding 
.the current status of articulation in vocational programs, (2) 
identifying the types of conditions which foster or impede arti- — 
culation, and^S) determining potential intervention strategies 
or models to improve, vertical articulation, " Kruger's paper 
looks primarily at the external aspects of articulation and coor- 
dination across* governmental levels and v;ith other publicly 
supported employment and training programs. Taking as his focus 
one vocational education course in one Michigan school system, 
Kruger identifies seven levels of intergovernmental relationships 
aod at least twenty individual relationships within these deven 
sets which can, at least theoretically, impact on this one course,. 
He also identifies another sixteen broad external forces , includ-- 
ing over forty-five subsets of relationships which impact on and 
shap^ vocational education. He' then outlines a series of ques- 
tions concerning just what coordination and articulation involve, 
what the barriers- are to coordination, and how coordination can 
be improved. 

Curriculum 

Calvin Taylor prepared one of the longest and most discursive 
background papers. When asked how long it had taken him to pre- 
pare it, Taylor replied, "All my professional life." The paper 
is an attempt to present many of the , ideas about transferability 
of skills that have been of major concern to Taylor. Three basic 
questions occur in several different contexts: '(1) what are the 
skills (or talents) people use most frequently in life, (2) what 



J-2 



^ I ) 



ERIC 



are the retention curves for different types of skills and know- 
ledge, andj (3) how can training be targeted to the skills that 
will be needed in actual performance? 

f 

William Knaak, asked to write about competency-based voca- 
tional education, raises 25 specific questions and research 
topics. These range from efforts to oT^tain consensus concerning 
just what chciracteristics constitute competency-based instruction 
to questions concerning its ef f ectiven\ess as an instructional 
method and how it can -best be implemented. Knaak list;s nine 
management and nine educational reasonsVwhy a personalized com- 
petency-based program was initiated at the vocational-technical 
institute which he directs. Ke calls fofv research to determine 
if these reasons are valid, and if they aVe, what is necessary to 
implement competency-based programs on a Wader scale. 

Data Collection and Evaluation \ * 

In his paper Joseph Malinski does not r^sel research 
■questions so much as outline a model for a data system for 
vocational education. It is a model designed foS'both operation- 
al analysis and research in votfational5«^education^in. contrast to 
data collection for research on or reporting abo\it vocational 
education. The system he describes integrates data subsystems' 
(about students, curriculum personnel , etc . ) across levels 
(national, state, local, individual person) . and educational ■ con- 
text (policy, goals, outcomes, etc.). Although MalinSki poses 
relatively few direct questions, a huge effort would be required 
to implement the system he .describes on. a national scale. . Would 
'the benefits in terms of program management and effectiveness ' ' 
warrant this effort? What type of investment would be necessary 
both in equipment and in • the development of personnel? Is the 
projected investment feasible in light of future resources likely 
to be available to vocational educatign? These and similar 
questions arise from a- ^pfi-sideration of the system Malinski 
describes. ^ ' 

Jeffrey Windom looks at another aspect of data needs for 
vocational education, specifically, the need to .have" information 
on the supply of skilled workers. He identifies eight areas 'in 
which better information would permit more' accurate estimates of 
the need for new workers. Four bf these areas deal with the 
dynamics of the labor market and four with the characteristics of 
job training programs and the f.it between these programs and 
labor market needs. Windom suggests a research approach for each 
of the research question he raises. 





The Skinkle-Greenwood and Klit papers both address the 
question of how evaluation in vocational education can be im- 
proved. Skinkle and Greenwood discuss some reasons that may 
have prevented the development of evaluation systems, some 
weaknesses in traditional methodologies, and some approaches 
that could be used to expand evaluation capabilities. For each 
of the problems they identify, a project is described that could 
either examine the problem in detail or test ways to overcome it.'' 

* John Klit, a state administrator, primarily addresses the 
practical needs of program directors . and decision makers. He • 
dempnstrates the need for exploring alternative evaluation 
schemes and methods ,. determining the. cost-effectiveness of differ- 
ent approaches and utilizing information from different methods ■ 
and sources into a consolidated model. Klit then suggests R&D 
activities directed to providing tools, how-to-do-it handbooks, 
that can be of immediate use to practicing vocational educators. 
These handbooks would cover how to conduct, report, and use eval-^ 
uation studies, espe6ially studies involving nonquant itative . 
methoc^ and lay' citizens . Klit also asks .if the legislative * 
mandate to test student achievement in vocational education? can 
be carried out. ' ' 

Planning * 

^ Allison Jackson, who was a 'local level planner and is now 
working at the stiate level,, chose to present her research sugges- 
tions in tabular format. She lists eight questions or problem 
areas in local level planning and proposes a specific approach 
for each one, including vlnstrumentation , sample population, and 
study procedures, and a need/rat ionale statement . The major 
concerns reflected in the research questions Jackson raises re-- 
late' to improving coordinati»on and communication in the planning 
process, for example, how to foster coordination of local advisory 
councils with state and regional bodies. - , 

Transition from S cho ol to Work ' 

Harry Silberman addresses the transition from school to work 
intrinsically and extrinsical ly and his paper yields two quite 
separate research agendas.. The extrinsic ,persp(*ctive involves 
studies of job market demands and analysis of labor market struc- 
ture and dynamics, and leads to questions about wa;^. to help 
people get and keep jobs. The intrinsic approach leads to ques- 
tions on how to improve the quality of educational experiences. 
In thjis area Silberman suggestrs the focus should be^ on the devel- 
opment of four types of instruijients , measures of (1) the degree 
to which different educational experiences have actually ' been 
implemented, (2) the personal developmenl of students, (3) 



,• individual attributes that modera-te the effects of different 
treatments, and (4) the organizational and ecological character- 
istics of the environment.' When such measure's are , available, 
Siiberman feels, it would -be possible to determine if educational 
experiences produce the effects: claijaed for them. 

Richard Graham was also asked to address the transition 
questions, and he approaches it primarily from. a policy perspec- 
tive.' He first confronts the problem of increasing equity in 
transition by asking how the transition curve for mino!rity. youth . 
. can be, made more congruent with the curve for white, middle cl-ass 
youth. He. then turns to mo;:e general problems concerning the ' ' . 
nature of a trans it iorj^ process ^path-model and how programs ca-fi 
be implemented to iifipact on this "models Kis discussion goes well 
beyond the traditiqnal problems of vocational education but are 
fundan\ental ^o many 'of them. 
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' RESEARCH AND DEVELOPM^INT ON ARTICULATION OF VOCATIONAL 
PROGRAMS ACROSS SECONDARY, POSTSECONDARY , i^ND ADULT LEVELS 



Howard M, Johnson . • 

Before discussing research and development needs in the area 
of articulation, it is desij;ablc to present a def ini tion .of the 
articulation process itself. One such def irfition * suggested at a 
1975 conference of vocational eduoaitors' in Washington State 
follows : ' * ^ ' • . 

Articulation refers to the relationships between 
educational programs which are designed tO| prov*ide 
•a smooth transition for the student frbm one educa- 
t'ional program to another. This movemehi:' of the 
student between programs can be either horizontal 
or vertical. Horizontal articulatipn 'includes thpse 
relationships between programs, courses, or activi-^ 
ties which exist at any one educational competency 
level and provide a coordinated educational program . 
fp'r the student. Vert iqal * articulation refeii^ to 
those relationships which exist between institu- 
tional\programs , courses , or activities and provide 
a coordinated program for the' student moving from 
one educational Comjietency to the next.* 

Certain .component parts of this definition are worthy of 
discussion as we attempt to define priority research and develop- 
^-ment needs in^the area of articulation. First, the definition 
focuses attention on the need for a continuous educational exper- 
ience for students. The important aspect of articulation as 
defined heris is not the elimination of duplicated services, cut-- 
ting costs, or the adoption of speci^fic forms of governance' over 
vocational programs, but it is^ rather the assurance of continuous 
progress for students. This concern for students should therefore 
'guide efforts to establish research priorities in the area. 
Second, we observe tliat the definition includes a concern for both 
hori^^ontal (within a single competency level) and vertical (along 
sequential competency levels) articulation. While this paper 
focuses on the vertical dimension of articulat^iori across secondary, 
postsecondary , and adult levels^', it is important to remember that 
both conce'rns are always present and cannot' be totally separated. 
The impossibility of separating these two strands stems partly 
from the problem of. making a clear separation between the academic 
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and vocational components of education- None of us is able to 
totally make this separation and we must therefore admit that even 
the most academic parts of our education 'have at leas-t some impact 
on our occupational lives; hence coordination between the academic 
and vocational experiences at any point in our training (horizontal 
articulation) is of crucial concern in preparation for vocations, 
A third focus worth discussion, now is the , inclusion- of competency 
level sequencing, along which vertical articulation \.s to bp estab;- 
lished. The assumption here is that articulation implies an abil- 
ity to define competencies along some continuum. ,If such sequencing 
of "competencies cannot be accoifiplishcd , we can assume that articu- 
lation is pr^obably not a ma^or concern to the educator. This may 
be the reason that vertical articula^t i<5n in mathematics programs 
is generally of greater concern to students and parents' than is 
vertical articulation in such areas as sacial studies 'or the arts. 
Mathematics is by its very nature a* more tightly sequenced set of 
experiences or competencies and the. concern for articulation is 
therefore much more important. Sequencing of competencies is 
readily accomplished in most vocational areas and to the extent 
that such sequences are essential. t6 learning about vocation, we 
K^onclude that articulation, itself becomes a much more important 
concern to those involved in planning and delivering training 
programs. • * ^ _ . ' . 

Having reviewed one suggested definition of articulation ,and . 
committed ourselves to a primary concern with vertical articula- 
tion, it* remains for us to identify some basis for examining re- 
search an^d development priorities. After reviewing a number of 
studies, including the 1976 study of articulation conducted by 
the National Advisory Council o^i Vocational ' Education i it seems 
that most i research and development concerrvp ' can be viewed within 
thb context of three broad categories : 

1. Understanding the current status of articulation in 

vocational programs. 

2. Identifying the types of conditions which seem to 

foster good articulation and those' which seem to 

impede articulation . 
'3. Determining potenti^il intervontiori strategies or 

models which might be used to improve vertical 
. ' articulation of vocat ional programs . 

The first category . centers on an attempt to increase our ^ 
(diagnostic capability in articulation. Diagnostic, as used here, 
refers to the capability of describing more precisely the extent 
to which students . experience articulation problems and the nature 
of these problems. In thi? second aroa, we arc concc^rned with 
predict inq tiio presence or^ abscTico of cjood articulation based on 
a host of varial)les. Important „ quest ions raised in this' second 
area are the following: 
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What state and local governmental arrangements are 
associated with good vertical articulation of programs, 
and are there arrangements which seem to work against 
' the development of articulated programs? 

What characteristics of administrative and instruc-- 
tional personnel are likely^ to be associated with good 
articulation practices? 

Are certain scheduling and instructional strategies 
(e.g., quarter courses, learning modules, employer- 
based learning) more likely to be associated with 
good program articulation? • 

The third broad cate'^ory of concerns focuses oh the merits 
of a number of proposed articulation strategies or models. In 
this area, we are not only concerned with the relative value of 
these several strategies but with a detailed description of the 
procedures and costs associated with .each Strategy. 

Included here are wide ranging lists of articulation strate- 
gies such as shared advisory committees, joint development of 
career ladders or competencies upon which to build programs, joint 
•program planning^ exchange teachers, shared facilities, and joint 
inservice training experiences. This particular category of 
research and development needs might be viewed as the search for 
solutions to articulation prob]\ems which exist in all vocational 
program areas an'd institutions T For this reason, it is clearly 
dependent upon the diagnostic and prescriptive information gener- 
ated from research in the first two categories* 

In the remainder of this paper, we discuss key questions 
which should be examined within the three broad -categories a'lready 
described. These questions were generated in a meeting involving 
three vocational educators fr(^ the Seattle area. Their names and 
positions are as follows: 

Roger Wing , Di rector of Vocational Education' ^ 
Bellevue Public Schools 
" Bellevue, Washington 

Gary Clyde, Program Disrector 

Lake Washington Vocational Technical Institute 
Kirkland, Washington 

Mary Phillips, Director of Vocational Pre/grams 
Edmonds. Community College 
Lynnwood^ Washington 
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These three have been invloved in a series of articulation 
activities partially supported by the Washington State "^minission 
for Vocational Education and under the sponsorship of the North- 
east Vocational Advisory Council (NEVAC) . This NEVAC group con- 
sists of nine suburban school districts, two vocational technical 
institutes, and three conimunity colleges to the north and east of 
Lake Washington. . • ' 

While the descriptive material following basically represents 
the ideas of the author, ,it is important for the reader to under- 
stand the process which led to the priority listing of research 
concerns. Utilizing the three categories of research and develop- 
ment concerns, these three vocational educators generated a numbeif 
of possible research and development questions and then priori- 
tized these concerns, discussing possible approaches to the 
research. Dr, Johnson refined the questions and added certain 
details to suggest research approaches. In the final two sections 
of this f<^t>rt are examined the list of K & D priorities and a 
set 'of R l& D approaches for 'those five areas judged to be potent- 
ially most beneficial to vocational education. 

List of Priority Research and Development Questions 

As mentioned above, a team of vocational educator^ assisted 
in prioritizing a list of key research and development questions 
and concerns falling into three broad categories. 'This listing, 
complete with a very brief description of possible directions 
for research, is provided here. A more detailed description of 
research approach or' direction is provided in the last section 
of- this paper^ but this level of detail is reserved for the few 
questions judged to be of highest priority, a group identified 
with' an asterisk in the list which follows: 

Category #1: Understanding the current status of articula- 
tion in vocational programs. 

1.1 To wliat extent do articulation problems exist at present 
, in the various vocational program areas and what is the 
nature of , these iir ticulation problems or barriers? 

Everyone seems to be talking about poor vertical articu- 
lation of vocational programs but there has been limited 
documentation of the level of articulation problems 
experienced by students in the several* vocational areas 
of agriculture, • business and office, electronics, power 
mech^micB, etc. 

It miqht be useful to interview a nuniber of stuc^ents 
(and parents) involved in these vocational programs to 
discoVGr ^he degree of problems actually experienced. 
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This type of research may assist in pinpointing the 
nature of articulation problems as actually experienced 
by students and miglit indicate the specific vocational 
program areas in which articulation most needs improve- 
ment, \ ■ 

1.2 To what degree is the public ready to pay for tha cost 
of improved articulation of vocational programs? ^ 

There are definite cost^ associated with better articul- 
ation of vocational programs, parti c\jp.arly if teacher 
and administrator communications is viewed as central 
to improving the articulation processes. Board members 
of the various schools offering vocational programs 
must be willing to pay for this communication time if 
it is to become a reality. Hence, there is need tp *do 
some opinion research among board members and the general 
public to determine the level of financial support 
likely to be directed in the articulation area. 

This type of research is extremel^ difficult and would 
probably entail the respondent making an actual allo- 
cation of fixed amount of dollars over a number of 
possible education needs. Unless articulation comes out 
receiving a subs4^antial resource allocation in the. pro- 
cess, it might be concluded that articulation is riot 
viewed as a high priority need by the public generally 
and we are not likely to succeed in directing additional 
resources toward this end, no matter how much we as 
educator-s may feel the need. 

1.3 What instruments or procedures might be used at the ^ | 

^ local school level to determine major barriers to articu- 
lation? 

The vocational director often hears of isolated cases of 
poor articulation in a given program area but it is 
r sometimes difficult to determine the numbers pf students 

adversely affected. What is being called for here is 
the development of a set of written instruments and 
specified procedur-os which might be used to diagnose 
the type and extent of the articulation problem ^within 
a s ingle school or school system . Some consortium of 
university and field personnel mirqht become involved in ^ 
producing a set of diagnostic ji^rocedures to'^e used by 
local vocational directors systematically identifying 
articulation problems . 
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Category #2: . Identifying the types of conditions which seem 

to foster good articulatioh and those which 
seem t(^ impede the process. 

2.1 What are the relationships between various governmental 
^arrangements at the state and local levels and the 
articulation of vocational progreims? ' 

There are those who believe that the c^overnmental organ!-- 
zation itself is a critical factor in the operation of 
articulated vocational programs. As an example, it may; 
be harder to achieve coordinated programs between publib^ 
schools and post-'secondary vocational programs when the 
governing bodies for the two types of schools are differ-^ 
ent . 

Working with a group of organizational experts and 
political scientists, it may be possible to identify the 
key organizational structures operating in the>several , 
states and to conduct research on the extent of articu- 
lation problems existing in these sample systems. Such 
research would no doubt be lacking in tight controls, 
but it might at least shed some further light on the 
degree to which articulation depends upon ttje' govern- 
mental structure itself. 

"2.2 What influence dp certain key personnel groups (e-g. , 
board members, school superintendents, vocational 
supervisors, counselc^rs, and teachers) have on the 
processes of articulation and what specific personal 
characteristics seem to encourage better articulation 
of vocational programs? 

Unless we know something about these personal character- 
istics which lead to greater concern about and success 
with articulation,' we are in a poor position to do 
anything to improve the ^situation. Hence, there needs 
to be^ research into those qualities which are associat*ed 
with good program articulation, Similarily, identifica- 
k:ion of qualities associated with poor articulation 
could be helpful i^n setting up betjter staff screening 
procedures and in planning staff development experiences 
designed to improve vertical articulition of vocational 
f:A^o grams . . 

2.3 What role do conf licting phi losophios of vocational 
• preparation and education generally have on the 
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development of gc^d articulation practices? 

Some people have hypothesized that a certain' amount of 
the articulation probleifn between tile several levels pf 
education ( secondary^ p0st-^ secondary , adult) has to do 
with the conflicting phjLlosophies exhibited by staff 
y at the different institutional levels. This may be true 
but we have minimal evidence of major philosopl:^cal 
differences at the several institutional levels. 

It may be desirable to conduct research into basic ^ 
additudinal differences between staff at the several 
levels. This analysis of differences should focus on 
views toward how students learn how much independence 
they should be given in the selection and conduct of 
learning experiences^ and how they should be evaluated 
in their respective programs. It might also address 
the question as to whether the diff erences ■ identified 
are serving as a barrier to good articulation of student ' 
programs and whether the differences can in fact be 
changed in any ways other than staff transfer. This 
latter susceptibility to change relates more closely to 
the Category #3 research and deVelopmcnt area. 

*2.4 Are there certain scheduling and instructional strate- 
gies more likely to be associated with, better articula- 
tion of programs? 

Under consideration here are a host, of hypotheses regard- 
ing the relation of certain instructional strategies 
or methods to the presence or absence of ,good articula- " 
tion of programs. These strategies and methods include 
such thiVigs as the time frame used for course sequences 
(semester, quarter, etc.), the type of instruction 
packaging (traditional course sequencing, individualized 
units, independent projects planned by students) , and 
tl^e grading and evaluation schemes employed. The central 
concern is whether ^ome of these strategies or methods 
seeiri to result in better articulation of programs as 
vieWed from the student's perspective, 

Categor|y #3: Determining potential intervention strategies 
I or models which might be used to improve' • . 

i vertical articulation of vocational program^ , 



i 

3.1 "Toi what extent do higher level institutions (e.g., voqa-- 
tional- technical schools and community colleges ) incor- 
.poratG "ill lieu of course:*' options and how effective 
are such options in achieving improved articulation? 
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A nuinber of schools have moved toward additional use of 
the *in li^eu of course'* options in recent years and 
have, developed specific testing and screening, procedures 
for assessing the merits of these requests for course 
waiver. As an example, a student who has spent three 
years working ip an auto shop ^during high school may 
request a#waiver of the two introductory courses in 
power mechanics at the local community college. If 
<^ such an "in lieu of course" provision is available at " 
. the college, the student woi^ld simply take the required » 
test and be placed in the course appropriate t'o his or 
her knowledge/skill . level . 

■ ^ 
It would be interesting to compare the barriers to ^ 
I continuous learning perceived by students attending .-in- 
stitutions with formal "in lieu of c^'ourse" options with 
those-of students attendii^g schools where no such options 
existed. A related area of research interest is the 
number of students in the different institutions who 
really exercise the option when available. There is^ 
some indication that many students rather enjoy repeat- 
ing certain types of learning ^nd may not exercise the 
option for co^urse waiver or substitute. 



^■^ "^^^ 3.2 What articulation gains most likely resiilt from the use 

of joint advisory committee^? 

The joint advisory coipiittcc (in this instance, the 
situation when more tilan one institution shares the use 
of an advisory committee) is often mentioned as a quick 
\ and inexpensive way of improving program articulation. 
Yet, there is little documented evidence that suqh 
committees result in a be ttgoc^ sequencing of programs 
. . for students transferring from one institution to the 
other.' • ^ [ 

^ ^ - s Documenting .^this kind of ovidence might be done in a 

\ couple of ways. First, administrators, counselors^ and 

teachers involved in the programs in question could be 
asked to simply list their opinions as tg articulation 
gains. A more convincing methodology would involve the 
review of course d.escriptions in programs and institu-- 
tions using joint advisory committees with those which 
do not^ use such committees. One could also interview 
representative samples of students in the two types^ of 
situations. In both cases, the researcher^ would be 
looking for definite evidence of supG:f'ior articulation 
in those programs and schools using the joint advisory 
councils . ' - 
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What are the major barriers to exchanging ' teachers be-^ 
iween the several school levels involved in vocational 
training and what benefits are likely to t)e gained from ' 
such exchanges? 

> • • 

If indeed the beginning of articulated programming for 
students is communication "among those pers6ns planning 
and teaching programs at the several school levels, it 
can be argued that staff exchange may be a very usefuX 
means of encouraging articulation in vocational programs. 
It may also be a factor in breaking^ down certain phil- 
osoptiical barriers which exist among ;the various schotol- 
ing levels. * 

\ ■ 

Certainly, the benefits of such staff exchanges could be 
documented more completely. Even moi*e important would 
be, a description of how the barriers to such staff ex- 
changes can be overcome. This is primarily a develop-- 
ment rather than research task and itt may very ;8itell 
include a set of desoriptions of actual staff exchanges; 

V?hat types of joint- planning (e.g., dareer ladder, develop- 
ment, program planninc^, test development, elimination 
of duplicate courses) are likely to be resisted by pro- 
fessional staff and what steps can be 1 taken to minimize 
this resistance? 

Vocational professional, staff at different institutional 
levels seem quite supportive of joint advisory committees, 
Joint career days, or other kinds of interaction involv- 
ing minimal cost or threat to institutional progiyams. 
There is evidence that other types of joint planning 
activity do riot receive this same level of support. 
Experience in one articulation project in the Seattle 
area ^showed that teachers were quite willing, to - plan 
together the career ladders which form the basis for 
their individual institutional programs but were much 
less interested in joint planning of courses or even 

course sequences . 

I . • 

It might be interesting to test the receptivity of staff 
to various kinds of joint planning and to examine ways 
to make joint planning less threatening to the partici- 
pants. Such research and development will probably 
require, at -a- minimum, the use of alternative planning 
mode^ in several different settings followed by. a mea- 
sure of staff roactiion to these several planning modes. 

To what exto^nt are facilities shared between institutions 
_and what impact does "such sharing have. on the articulation 

of "prg^cjrams? 



It might be useful to have better information on the 
amount and types of facilities sharing going on in 
Vocational programs. More important is an appreciation 
of the articulation impacts associated with joint fa- 
cility use* There seems to be» considerable interest 
in joint facility use, particularly is light of enrQll-* 
ment declines in selected program areas . 

In the teacher training area, there is an obvious 
potential for joint facility use. Having potential 
teacher candidates gain most of their skill training 
in feeder community colleges can certainly limit the 
need for extensive laboratory facilities at the four- 
year college levels where more and more of the practicum 

V teaching is being done at field sites. Questions to . 
be examined here would focus on the^ level of progra^m, 
coordination accomplished when facilities are used 
jointly as compared to when they are not. Examination 
of prograiji documents and course descriptions along with 
selected interviews with^students in the two settings 
would be a suggested method of data collection. It 
might also be useful to document cost saving achieved 

• through various types of joint facility use. 

3.6 To what extent can better informed counseling and -teach- 
ing staffs facilitate the articulation . of vocational 
programs across the several institutional levels? 

' , ■ \ 

The accuracy and ,amount of information obtained by 
students from 'courfseling and teaching staffs can be^ 
expected to have some impact on the continuity in the 
student's career ^tf aining progr^- The kind of research 
and development needed in this area, will be fairly 
expensive;, it will entaii both training and assessment 
components along with some reasonable control ^over 
general faculty competency levels. In order- to examine" 
the impact on continuity of student prc^grams, this level 
of research should probably be done on a longitu<3inal 
basis, adding even more to the time and qost* 
^ * 

Despite the time and .cost obstacles, this might be an 
^ extremely important area for .additional research and 
-could yield insight into the types .pf staff develop- ' 
ment programs needed to increase faculty capacity for . 
supplying needed information for students. If informa- 
tion about future learning qpportunities is essential 
to continous career, and vocational developnient , it is 
important that we develop better ways to deliver this 
information, to students. 
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3.7 Do career orientation programs involving students 
/^d faculty at different institutional levelg i^nprove 

articulation for students enrpllod in vocational ^ 
programs? 

Career orientation program^ in which a higher level 
. school invites students and faculty from several 

potential feeder schools, are .suggested as one way to 
increase communication among faculty and to assure 
accurate information on the part of the students. 
It might be useful to follow up on some of these 
prograjns to assess their impact on students. This 
would require surveys in which a cross section of 
student and faculty participants would be asked to 
assess the value of the activities . vlt might also 
be useful to develop a set of guidelines as to how 
such ^ or ientation programs are best' planned and 
implemented . 

3.8 , What are the more promising models for improved 

articulation of student programs and what are the cost 
implications for each? 

This is clearly a different sort of question than 
the others and is purposely placed at the conclusion 
of the list» It is a development need and depends 
upon identification of the more successful of the 
intervention strategies and models considered in 
previous questions. 

The end result of this deve l6pmerlt activity ,would 
assist 'the vocational director and system administra- 
tors in selecting models 'of articulation most* 
suitable to their own local situation. . Perhaps it 
would result in a document • simi lar to Student 
ArticOlabion Between. Secondary and Post-Seconl^ary 
E cH;c a t Ion (a pamphlet developed in .1,974 by the Texas 
A & M Uni'versity Career Education Articulation 
Project) but with detailed cost figures associated 
with the several suggested articulation mode Is * 
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Suggested Approaches in Area s of Highest Priority 

Because of the limited time for this activity ^ it made 
senge to concentrate the research and development planning on . 
the: areas of highest priority. With this in mind^ only those 
are'as which were marked with an asterisk in the previous section 
are considered in these more detailed research and develop- 
ment approaches. Even here, only certain components of each 
high priority question are considered in the suggested 
research and development procedures. In all cases, these are 
only tentative suggestions for research and development and 
more work will be required in arriving at detailed methodologies 

Question 2.2 — What influence 'do 'certain key personnel 

groups (e.g., board members, school superintendents, 
vocational supervisors , coxmse^ors , and teachers) 
have on the processes o:f articulation and what , 
specif ic" personal characteristics seem \t6 encourage \ 
better articulation of vocational programs? ^ | 

r « . ' 

%ne way to research jthis area is to do a fairly - 
detailed analysis of the types and levels <^f , ' 
articulation in a number of school syst^ems / and/or , 
schools across the^ United States or even within a 
few selected states. It might be good to describe 
at least 20 to 30 different school settings* The 
descriptive -work would probably have to be accomplished 
through interviews and the intent would be to weigh - 
the amount of concern for articulation and 'the depth 
of commitment to removing articulation - barriers 
in the many school* settings . , ^ ' 

Once this descriptive work is accomplished , it would 
be necessary to intensively analyze key personnel. 
It might be appropriate^ to focus oh bo^rd members, 
superintendents afid vocational supervisors or - 
directors in the first phase . of the research effort 
an4 attempt to find out if the better articulated 
programs seem to be associated with certain types of 
board members; and administrators. At this point, we 
would be interested ' -ki personal characteristics , 
beliefs , and attitudes of these key personnel It 
might also be useful to examine actual - policy . state- 
ments and administrative actions which cquld^ account 
for the varying levq Is of articulation ip the several 
school settings . . 



Because conditions' are 'Ifc different in rural^ sub- 
urban^ and urban settings, this"* typte of research 
might best; be done by picking both secont^ary and 
postsecQndary sqhooi 'settings in leach of the basic 
community . types . ' • / 




*The suggested 20-30 school settings would be an 
. absolute minimum, particularly if there is an effort 
^ to. stratify by community type* The research study 
will require considerable time, both in the develop-? 
ment of procedur^es for assessing the school commitment 
^..to articulation matters and in the designing of pro- 
'cedure^ for .obtaining information on the character- 
- istics' cWid attitudes of key school personnel. 

Question 2.4 A*r(f there certain scheduling and instruc- 
tional strategies more likely to be associated with 
'better program articulation? 

While there are -numerous scheduliiig and instructional' 
approaches which could be examined, of -considerable 
, interest is the building of course units around small 
learning modules. Many advocates,, of good articulation 
of vocational programs have made the claijn that s,uch 
, , sequencing of instruction is necessary to"* assure 

continuous learning by students. It might be useful 
to do some careful research to e^^niine the impact 
of such instruction on students' perceptions of th^ 
level of articulai:ion achieved^ 

This research v^ould probably be expensive as it' would 
tequire the development of a curriqjilum sequeiace in 
such areas as auto mechanics built entirely on small 
Iparni'ng modules. This sequence ivould have to begin 
with basics taught in, the courses in high school and 
conclude with more advanced work normally reservd^ 
for the vocational technical institute or college* 
Once , the course^ Sequence or sequences have been 
developed, it would be desirable to pick pairs of 
high school-college institutions in which to install * 

,^ 'the -sequenced' curriculum, FISV each, pair of schools 
agreeing to opcra^te the module-based curriculum, ^ - * 

, it would be necessary to select a" control pair .where 
such instruction is hot * operating . Student change 
in these ^wo sj/stems over a series of years would then 
, . have to be observed. 
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^nin?! 1^ "'^^''^ systeips (one usinq the 

module-based approach and the' other usinb -.more ^ ^' 
• , traditional courses) would include the frequ^ncv of 
advanced p:bacement in the proarai. as students move ' 
•from one institutional level to the nevf • 

through the curriculum, .the attitudes of students 
tqward ±he two types of programs, and the "students ' 
. perceptions of the level of articulation acMeved 
in their own learninq-^rooram. 'icnieved 

- Certain vof the . con tr^ls may be difficult to achieve 

(e.g. experiinent.al/and control simlarity in all 
. respects but the us4 of leArriinq modules, a^d ?he 

cominit^ent to use^of modules in'the so!ectlS treat- ' 

• T.rr\lT""l^ research would, have to .be 

carried out over a series, of several y^ars; howevel- ' 

uppbrt f^r'tL'r""'"^"' '"^'^'^^ intfthe' decree Of 
• support for the learning module approach amonq 

vocational faculty and the level of articuTa^ion 
■ p^oacr "^^-^^-^^^^^^^^ ' 

"""'teachers Wwef " barriers to 'exchanging 

teachers between the several school" levels involved * 
in voca-tional .training and what benefitl are nke!v ' 
to be g-ained from such exchanges? ^ ' ""-^y 

actTvitv^'^f.^w^'i • l^ra^l^_ a development / 

activity. It would first be necessary to assess the / 

extent to which exchanges have been carried out in ■ 

recent years, by samplina vocational teachers and 

sSi2f'T°''' three, or four representative • " 
states. Having determined the level of exchanao 
activity, it would be desirable to conduct intensive 
interviews of those persons involved in the exchanqe 
This would include not only the persons bxchang^n^ • 
positions but certain others (e.q., supferintendenL ' 
business officials, coUeae ptesid'ents) who fac^Ut^te ' 
the cxchanae. InforiP.ation qleaned from these inter- 

- . views would offer first hand documentation of t^e problems 
and perceived gains of exchanges.' De f^ni te ■ areas" ^f.""^^^"^^ 
-concern would be methods of handlinq stch i terns .as / 

, ^^tirement benefits, salaries, student advisihq, 

V - ■ • •• . 

-.^nce the interviews are completed, it might t)e useful' ' 
to write -a brief description of the differetit types ' 
of exchanges available,. a:^ng with suqgestions for 
overcomina obstacles. This description miqht be 




.useful to vocational administrators across the country 
'"'ais they attempt to' sell their superintendents, presideats 
and Voards on the merits of an exchange program. To 
my knowledge nothing of this sort is cutrently avail- 
""ableT ' , * 

' / * Ifi' in a preliminary examination, it is found that 
very^ few exchanges among vocational personnel have 
taken place, it may be necessary to draw inferences 
from exchanges involving non-vocational personnel 
at the different school levels. Whatever approach is 
used, it is important to remember that the aim i: 
primari ly one of iderftif ying the potential problems 
• associated with the establishment of exchanges beitween 
.personnel at different institutional levels. The\ 
document^t ion of bene fits aained is of secondary 
^ importance ^nd can probably be satisfied by intervi^vs 
with those persons directly involved. Trying to 
, document these gains ^ased on student perceptions of 
"articulation level seems a futile exercise. The level 

of «Vi:ontrol over these exchanges ' (which have already 
' occurred) is simply too great to waste time looking 
; at question^ of student perception. * . 

Question 3.4 -7 What 'types of joint planning (e,g,, career 
ladder development, proaram plannino, te^t de^lopment, 
elimination of duplicate courses) are likely to be 
* resisted by . prof ess ional staff and what steps can be 
taken to ijtinimize this resistance? 

.« ■ ■ '# ' 

One could approach this assessment of. resistance by 
surveying faculty on se\7eral joint planning activities . 
' Esse'ntially , a number of planning options would hava'^ 
to"^ be identified and respondents tvould* have to indicate 
their, degree of acceptance of each.j The respondents 
might be* asked their . reasons for not endorsing ^ some 
of ^he p'lannincj options;' Such opinion surveys are 
relatively inexpensive to 'conduct but may offer super- 
ficial results. People sbmetimes don ? t know the 
extent of their* feelings toward certain types xsf joint 
9^ planning without h'aving directly experienced the- activity 
Furtherjnorq , it is, spmetin^s difficult to describe the 
precise nature -qf the possible activities to be ' - 
considered. ' • ' ' * * 

; - i * ' * 

Due to these di f ficultio^ , it might .make more sense 
to actually conduct certain kinds of joint planrving 
and then assess the receptivity to these activities. 
Unf prtuftate ly , this approach would be much more 
expensive in that it would involve support for 

r ' ' ♦ . , " 
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joint planning. As an example,' we might support 
the development of career ladders under several 'dif- ' 
ferent conditions and examine the resistance' exhibited 
by staff.- As a specific instance, we might want to 
check whether^ the development of career ladders to 
build joint curriculum to be used in 'the several 
institutions would meet with less favor -than building 
the same career ladders to, design test instruments and 
procedures to be used on a 'voluntary basis in the 
^several school settings. Thds sort of. career ladder 
\levelopment work has been started in the- Seattle area 
by a group of teachers, working in the so-called ■ ^ 
NEVAC districts and ^ the level of support has been ^« 
reasonably high. This support might- hot have existed 
in other circumstances* What is proposed here is an * 
effort to evaluate this receptivity in several dif- 
ferent situations,* ♦ ' • - 

* This research might be combined with -the search fgr , 
^ personal characteristics likely to be most supportive 
of ' good articulation practiqes -in voca'tional education. - 
This, of course, relates to Question 2.2. Tke» concern 
here would be ^e identification of personal traits and 
attitudes which seem to. contribute mo'fet to career 
ladder 'development or other forms of joi nt . curriculum 
planning. Identifying traits conducive to articulation 
may later prove- helpful in designing staff selection 
and staff development programs. 

'^Juestion 3 .'6 To what extent can better informed 

counseling and teaching staffs f aci litate ,the articula- 
tion of vbcational programs across the several ' ^ 
institutional levels? ' • * . 

Again, in this case, we are interested in whether ' 
more complete and accurate infomation about program 
segucnces makes a difference in the articulation of 
programs. On a long term basis this kind* of research 
would be di f f icult to assess due to the many other 
variables (o.a.; *homc , * church ^ clubs , worlc , etc. ) 
whi impact up oh proaress ■ "In school . In the shQi't 
run, however, it may be possible to see^if better 
information by younsolors and teachcrs^increases the^ 
student ' s perception of option^s aval l^ble in' the immediate 
future. While* this sort of perception is no assurance 
of a continuous and , art i culated tTaining program, it 
'is difficult to ^e'e ^:^iow such a program could be ac- 
complishixl wi iliout " th i s accurate^ pe rcept i on ^ of major 
opt: ions available. 
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One way to approach the research question is to develop 
at a series of community colleges (or other schools 
providing advanced trainina in vocational areas)^ short 
orientation prc^rams for counselors and teachers in 
nearby feeder schools. If students* in the feeder 
schqols are tested both "before and after their 
teachers and counselors -participate in orientation 
programs ^ one could assess the increased student 
awareness ^of vocational training possibilities. 
It would probably be necessary to set up control groups 
in ^ the same feeder pattern of schools in order to 
separate that portion of increased Student awareness 
which* might be due to increased maturity and other 
non--school related factors. It woul4^ also be advisable 
to examine this matter in at least fifteen or twenty ^ 
schools so the results could be generalized to a 
number of settings; The central research question " 
is whether the increased awareness by teachers and 
counselors results in any increaseci understanding of 
training options on the part of students. We assume, 
of course, that this incrqased understanding of 
^training options leads to better articulation or at 
least increases the possibility of the student ' 
selecting the option or options most consistent with 
current iTfeed. This suggested approach to research is 
admitte'dly only one small dimension' of the total 
question being raised in this area but i^ appears to 
be ond which is clearly manageable. 
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■ ' ^REFLECTIONS VOCATIONAL EDUCATION v ^ ' 

IN TERMS OF RESEARCH POSSIBILITIES 

^Daniel H. Kruger 

\ Vocational ediTcation is one of five major public supported 
envployment and training delivery systems. The other four are 
(l) "federal/state system Of public employment offices - the job 
service, (2) f ederal/state vc>cational rehabilitation programs-, 

(3) the work incentive program for welfare recipients, a-nd 

(4) the Comprehensive Employment and Training Aet (CETA) program 
To put the vocational education' delivery system into perspective 
it is. necessary .t,o analyze what vocational education embraces, ' 
It includes a range of .cout-ses from an dlementary course in 
cooking .and sewing to courses in airplane maintenahce^nd com- 
puter technology. These varieties of coursfes are offered in 
high schools, area skill centers, technical institutes and 
community coLleges.' Each of these institutions is a delivery 
point or delivery station for vocational education programs. 

The planning, development, funding, and iinpjementation 
of vocational education programs involves seven sets of 
intergo^^eJ:nmental relations which themselves contain some 
twenty individual relations. All these relationships shape 
nation^al, state and loc^l education services. . The vocational 
instructor teaching a course in auto mechanics for fifteen 
^students at the Area Skill ^ Center in Mason, Michigan, is 
supported by the complex superst ructui^e of administrative 
agencies and sets of intergpvernment al re lationships presented 
in Table I. ^ 

■ Each of the individual and intergovernmental relationships 
noted in Table I .^can be the subject of research. .It is 
necessary ta identify the more critical of these relation- 
jships and^theri to carefully examine their impaction vocational 
education. In addition t?o these intergovernmental#:re lations , 
there are at^least si,xteen broad* external forces which shape 
vocational education which are listed in. Table II. These 
sixteen broad external forces cover at least forty-seven 
subsets.. Obviously all 'are not of equal importance but in 
-reflecting on what shapes the nation's vocational ^programs ^ *^ 
thesQj appear td be worth noting. 




TABLE I 

Sets of Governmental Relationships 
Affecting Vocational Education 

A. Federal lati on ships 

1. President/Office of Management and Budget/Congress 

2. Office of Nianagement and Budget and Department of 
Health, Education and VJelfare (HEW) 

3. "HEW and Office of Education (OE) 

4. HEW/OE and Department of Labor 
:B. Federal - St^te Relationships ' i 

5. 'Office of Ec^vication and State Departments of Education 

C. State Re lationships 

6. Governor and Budget Office 

7. Go<rernor and State ' Legislators 

8. Budget Office and State Department of Education 

9:* 'State Superintendent^ and other units of Sta-tfe Depart- 
ment of Education 1 

i ■ ■ . 

10, State vocational agency and ^other state agencies: 

(a) State Employment Service (Job' Service) 

(b) State WeLf are Agency (WIN Program) 
_ (c) State Vocational Rehabilitation 

(d) St^te CKTA Office . { 

11. state Legislators and State Superintendent of Education. 

12, State • Vocational Education Agency and State Advisory 

Council oa Vo(*ational Education ' j» 

f 

13. State Advisory Council on- Vocational Education and 
< ' State Manpower Services Council 

D. State and Local Education , Agency Re-l at ion ships ' 

' * —5 ■ ™ — ■ * ■ ■ ■ 

'14. State Department of Education .and Local School " i 
Boards of Comm unity Colleges ' 
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Table I) continued 



Local gducation Agencies and their relationships at the 
local level 

15. Attitudes of School Board or Conununity College 
Board of Trustees tgward Vocational Education (in- 
cluding allocation of funds %for vocatior^al education-) 

16. Attitude of Chief Administrative Office of School , • " 
Board/Community College toward Vocational Education 
(inlcuding allocation of funds for vocational 
education) 

17. Attitude of other departments of school or college 
^ towards vocational education - 

18. Attitude of vocational education directors toward 
program and its interrelationship with other govern- 
mental programs 

(a) Local Vocational Education Agency and CETA 
Prime Sponsors 

(1) Attitude of Mayors toward Vocational Education 

(2) Attitude of CETA Staff toward Vocational. 
Education 

^ ih) Local Vocational Education Agency and Corrections 
[c) Lo c a Implication a 1 Education Agency and Local 

We 1 f »ije*'s^e n cy 
(,d)' Local Vocational^ Education Agency and the Public 

Employment Service ^ 

(e) Local Vocational Education Agency and Vocational 
Rehabilitation 

(f) Local Vocational Education Agency and the> area 
Conmunity College ^ • 

(g) Local Vodationai Education Agency and the are^a 
Skill Center or*^ area Technical Center 
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Table 5, continued 



Federal - State - Local Relationships 

19. Federal funds for vocational education which are given 
to the states on the basis of some formula and which 

,in turn are distributed to local education agencies 
for vocational education on the basis of cert^i^i 
criteria. Of particular significance are th^' guide- 
lines of both the Office of Educatibn and the State 
Department of Education for diSls^ribution of funds. 

Federal *- Local Education Agency Relationships 

20. Federal grants given directly to local education 
agencies for demonstration projects. 
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TABLE II 

Sets of External I^eiat ion ships to Vocational Education 



^ A. Attitudes toward vocational education -of the following 
students: ' 

1. Black 

\ 2 . Hispani.c / . ' u 

\ 3. White ' . t 



4. Male . ' ^ 

5. Female, ' * 

B. Attitude toward vocational education of the following 
parents : , 

6. White 

7. Black . . . 
8 . ' Hispanic. 

9. By s-ocio-economic class' ' 

C. Attitudes toward vocational education Jf the following 
employers: 

♦ * 

10. National firms ' 
(a) Local branpHes 

11. Local area employers* 

(a) Private sector 

(1) Large " . ^ 

(2) Medium ^ . ' 

(3) Small ' ^ * ' " ^ 

(b) Public sector ' ' ^ - m 

D. Attitude toward vo9ational education of the following' 
employer groups: 

12. ■ Chamber of Commerce of U, S. 

13 • State Chambers of Commeirce ^ i 
1-4. Local Chambers of Commerce ^* 
15'. National trqde associations 
16. State trade association^ 
17^ Local trade associations 

18. Interaction with these groups* • , 

(a) What works^. 

(b) What does 'nj^t work 
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Table 'II, continupd 



E. .Role of local occupation/trade advisoj-y commi^ttees 



F. 



19* Extent to which they interact wit;h employer groups 
(see, "D") ^ 

i 

Attitudes towar(3 vocational education 'of the following 
unions: 



20. AFL-CIO ' 

21. Large international unions 

22. State AFL-CIO federations * 

23. State building trades councils 

2 4.. Local AFL--CIO federations . * 
,25-, Local unions ' 
^ 26, Note: Do those building trades unions which have 

extensive apprenticeship programis— see vocgtronal ^ 

education programs as competition? , . 

G. Attitude's toward vocational education of the following 
community based organizations: 

27. -National Urban League. • 

1| (a) Local affiliates of National Urban League - 

28. National Opportunities Industri alization ^Centers • 

(a) Branches of Opportunities Industrialization Centers 

29. ^ National Service, Employment and Rehabilitation 

fa) Local branches/chapters 

30. National Association for Advancement of Colored 
People (NAACP) 

(a) Local . chapters , 

H, The educational establishment (associations) 

^ 31. American Vocational Association 
32, National • Educat ion Association 

(a) State Education Association 
:33. American and State Federation of 
34^. .Other national and state teacher 
interest in vocational education 

35. State associations of vocational education directors 

36. National and State School Administrators Association 

37. National and' State Association of School Boards 
^'38, Other national or state groups with an interest in 

^ vocational education, e.g.^, Ass<:^ci at ion of Community 
Colleges ( t}>e.. groups that testified on the 1976 
amendments ) - I 



Teachers 

groups with an ^ 



X 
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Table , continued 

Publications dealing with vocational education 

39. " Note: Whatsis their impact on vocational education 

.and who reads these publications?- 

Busiijdss - Educa'^ion groups and their involveifient in 
vocational education. 

V 

40. Examples: 

(a) . National Association for Industry /Education 

Cooperation ' " 

(b) Industry Education Courtci Is of America 

(Note: I^at do they do to foster- vocational 
education?) ^ . 

Universities and the training of vocational teachers 

41. What are universi ties/cqlleges of education and 
colleges which prepare teacher doing in the" prepara-'' . 

^tion of ■ vocational teachers. 

(a) What are the curricula and emphases? 

(b) Are vocational teachers being adequately prepared 
to' deal with both internal and external forces 
affecting* vQCational educ^ation? • 

Certification of vocational], teachers (This is both internal 
an^ external) 

42. (a) What is the current status of the state certifica- 

tion laws for vocationki teachets? 
-XbX^ How do these laws handle, the n^on-certif icd 
teachers in vocational education? 

(c) How do laws certifying ayto mechanics affect 
vocational programs in auto mechanics? (e.g., 
Mi chigan) , . 

Impact of collective bargaining on vocational education 

43. ' Many states ha^ve laws which permit public employees, 

including public -school teachers, to engageMn col- 
lective bargaining. Even in the absence of a state 
collective bargaining law, schooled! stricts sometimes 
engage in collective bargaining. There is a ne^d to 
determine if collective bargaining in public educa- 
tion has created" any unique, problems for vocational 
education. . ' ' , \ 



' ' Tabte II, continued 

N. The impact of private occupational schools on" ; • ^ 

vocaticjfial education . ^ - 

* 44. The private occupational schools are growing. 'Why? 

Are these privately owned. schools in. competition with, 
^ publicly supported vocational education? To what 

■ • extent are these schools involved in institutional 
traii^ing Supported by the Comprehensive Employment 
.'and Training Act? Why are these school^ involved 
in CETA programs' rather than public vocational 
education programs? 

O. The counseling establishment. ^ * 

■ . * ^ f. ' 

45. 'What^are the attitudes of school counselor^ towards*- 
, > vocational education? (This is also an internaT f actor) 

4.6, What are the attitudes of . national associations of 
counselors/quidancG towardsj. vocational education? 



P , /^he 

/ voca 

/ ■ 



interrelationship between apprenticeship ^programs and 
tional educational programs. ^' ^ 



47. There'were approximately ^ 255 , 000 registere4 apprentices 
in the U. fS. at the end of 1976, Litt^le is. krfown 
. about the relationship between Hpprenti^ceship < programs 
and vocational education . Foj* example /JioW many 
students in vocational education courses move on to 
apprenticeship programs?^ Do apprenticeship programs 
draw off potential stiaden^t^s in vocatipnal education? 
St:ill another area of investigation is the traj.ning 
centers operated j-Ointiy by building trade -unions and 
contractors* What impact do these trade schools have 
on apprenticeship programs? To what extent i,s- voca- 
tional education involved in the classroom training 

J; m apprenticeship programs? 
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Research Qaestion4 
"% — ' 

The intergovernmental relationships and external factors 
outlined in Tables" X and II shapd the nation's vocational 
education program. There is needi however, to identify what . , 
constitutes "a good vocational program." This is a deceptively 
simple' question. Eagh of the major actors in the vocational 
education system probably has different criteria. The major 
actors are (1). student, (2) parents, (3) school administrators, 
'(4) vocational educator -director, (5) the vocational education 
instructor, and (6) the employer. It would be ^tremely useful 
if thel^^r .perceptions of what constitutes a good vocational 
program could be identified. Such a project -would help 
put |the roles of the major actors into perspective. 

It appears that the term vocational education is meanings- 
less. .It is too broad. A cooking class in high school is /not 
the same as an institutional cooking class in a community • 
college yet both fall within vocational education. There are ' 
other examples wHich blur the* objectives of vocational educa- 
tion. This raises the question, what are the objectives of 
.vocational education? The identification of objectives is 
related to what constitutes a good vocational education , y 

program. ^ ^ . . ' ^ ^-'r. • ^ ^ 

. Earlier the major actors in , the vocational , education * ♦ 
delivery system were identified. The vocational education 
instruotor . is one of the major actors. . An interesting study 
would be to anaiyze^the job descriptions of a .selected number 
pf vocational education instructors to learn what the school 
administrators expect of them. The vocational educa^ion^ 
instructor is different from a math teacher ©r an Engli^ 
teacher, for the^. vocatiohal education instruetor if he/she is on 
top of his/her job m'ust* relate* to advisory "Committers , .employers, 
. etc.^ whereas the ir^ath or English teadher, for the mosi part, 
operates in, the classroom. If the pay is the sawe for both ^ . - 
teachers-- the math teacher and the vocational edu&ation 
instructor-- ttie latteir may say to h^iniself or to herself, 
"Why should^ 'I relate to the groups' outside the school when the 
reward system gives -no ' recognition to this job functiort?" 
This situation suggests another area of study, namely, 
salaries vocational education instructiors as compared 'with 
other teacners. All teachers are ^ot worth the same but the 
salary schedules prevalent in public schoolb assume tt]at 
they are. The reward system may be a key factor in expla^ining 
the poor articulation. 

The reward system is also influenced by col lecti ve bar-- , 
gaining and it is 'for this reason that collective^ bargaining . , 
was included in, the external factors affectincj vocational 
education (see Item M) , 
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Vocational education is funded from ,ffederal, state and 
local ^viirces. Without local support of vocational education 
in J4iciii^an , the program would be caily a fractioft of what it 
is."" Th^, ,f ede^-al government contributes about $24 million,- 
the static appropriates about $26 million and the local school 
districtis raisfe about $102 million. Federal funds •represent , 
only 16', percent' yet the federal re.gula"t ions assume major ^. 
importance . A -similar observation can be made about the 
. state's - in vo.lveroent. ' The relative smalX gerieral and state 
contribtaiioi^s to vocational education may help to explain, some' 
of the tensixsns between local education agencies and tke 
federal and state partners. 

Another general problem area of vocational ed'ucation is the 
quality of ^ p la ceit^nt services. €t is not known how many * - 
scho6l«/v^cat4o*nal programs haye placement seirvices. The 
manner in which vocational- education programs seek to place , 
their stiidents is an area of investigation which could provide 
useful suggestions to school basfed placement services. More- 
o'^er such- a study wop Id identify interrelationships between tbe 
school based placement services and the publicly supported 
Job Service;; In addition, infornjation is needed , on tbe extent 
to which 0ETA prime sponsors have .financially supported s<jftiool 
based pracement services. Table III cittempts to outline the 
questions and issues related to coordination and articulation. 
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TABLE III 

Articulation d^d Coordi-nation of 
Vocational Education with Other Programs 



I. Definitions smd Objectives 

A. Definition of coordination 
-B. Definition of articulation , - " , . . I 

C. ' Differences betvreen coordination and articulation '\ 

D. Objectives of coordination - why important? 

E. Objectifies of articulation r why important? 

II. With what groups and institutions is, coordination 
desirable? ~ • • • •. 

Note: If the ^oal is better coordination then it is 
neces^sary to examihe what groups should be involved • 
These groups vary from cpnmiunity to community depending 
oh size ^' location and what iSi{ available. 

III. With what groups and institutions is articulation 
'deii^able? (see Note in Item II) ' .. 

IV. . .Why should vocational, education be coordinated with. 

other programs? . ' 

A. What will the vocatioi^al education ptograms 
^« gain or- lose? 

B. , What will the other agencies/institutions gain or 

lose from coordination? ' - 

Note: Coordination involves a kind of exch'ange theory, 
namely, what does one give and what does one Receive 
in return from coordins^tion? The exchange theory in my 
view differentiates articulation from coordination. 
In articulation, information | is usually exchanged, 
but in coordination, the emphfasis is on programmatic' 
considerations. Articulation is 'therefore , in my view, 
easier to accomplish than coordination. 

V. 'Who will do the coordinating? 

If the goal is better coordination, then someone must 
do it or take the initiative. Taking the initiative 
does not guarantee a response from the other agencies 
or programs. There must be some kir^d of. exchange, 
theory operative (see Note' in Ptem IV) . 
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Table III / continued 



VI. . Identification of Barriers to coordination in specific 
commvmities ^ 

A. No financial incentive for effective coordination 

Note: Staff melnbers^are usually, not rewarded for 
^ effective coor^inatibn • An interesting project 

would be to revie;w job descriptions of vocational * 
instructors and vocational education directors to 

their job responsibilities is to 
coordination is not paVt of tKe job 
is doubtful whether anyone would\ take 



learn if \one of 
coordinate. If 
description,, it 
it seriously. 



B. Differing enabling legislation ' 

C. Differing organizations 

. D. Differing criteria as to what constitutes 
"effective coordination" 

Note: These barriers can be examined through surveys 
and questionnaires of those agencies which' should 
be involved in some form of coordination. 

E. Differing levels of coordination ,^ * 

iJote: As an ex^ple^, one level of coordination is 
to refer clients of one Agency to another agency. 
Another levels is ^fqr one agency to give funds to 
another agency to perform services^ tor the former 
* agency's clients. ^ : / ' 

• . ' - , ' •■• 

VII. What dart be done to improve coordination? 

A* Dp agencies want to be involved in coordination? 

Note: Employment and training agencies ate alrea 
involved in some levels of coordination without 
knowing it. These aforementioned leve Is of co-- 
ordiniation. need to be clearly identified so that 
'[ agencies can begin to eliminate these impediments| 
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THINK PIECE ON. TRANSFERABILITY^ 

^ Calvin W. Taylor 

f ' . ■ , 

\ ■ ■ • . • ■ 

Prelimia^y Commentg . 

Wr.itten as a think pi^ce, this report captures the main 
ideas about transferability that have occurred, to . over th(^v. ^ 
years or that are npw troubling me. One of my mtisical friends*^, 
once^ recomn^nded that a composer should compose just the right 
amount,' not too much qr too little. In this way he/she leaves 
enough room for the performers to add, their talents so as to , 
make th^ total effort roost effective. This paper approaches 
that state. 

' ' ' . .- 

Although I am not. involved in day-to-day work dn vocational, 
education, my basic research has been career-competency bAsed. 
During the last few years, I have worked several times wi^h the 
National Center for Research in Vocational Education at- the ciiio*^ 
State University, ^ost relevant to this pape'r' was my wooc with 
the National Center's project on transferable skills {s^ references) . 

' Pratzner (1977). lists. exarnpleB gf transferable j|kills and 
characteristics within the following sections: ' 

1) Summary of Generic Skills / 

2) Attribute Requirement Inventory 

a. General Vocational Capabilities 
h\ Cognitive Abilities 
c. Psychoijiotor Abilities 
• ^ , d. Sensory Capacities 

e. Interests 

f . Needs 

3) List of Attributes Developed by Mecham . ' ^ 

4) OccupationaL Survival Skills 

5) Composite List of Transferable Skills 

It is assumed that the reader has access to the reports frcm the National 
Center's project on transferable skills. I have tried to write, 
this think piece as taking off from and going beyond those reports. 

I. EARLIER REcdMMENDATIONS ON TRANSFERABLE SKILLS 

As a result of • this earlier project, I drew at least two con- 
clusipns. First, ^ome attributes are more |^central to people's 
total set of career and life p^formances fend therefore are widely 
♦needed with at' least moderate spread effects. If thesi attributes 
were the focus of education and training, ^tudents could obtain 
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from such programs great benefits both for thei^ careers and lives. 
Second, selection and training, programs should be as much "on "tar- 
get" of their ultimately desired performances as possible if trans- 
fer Of spread effects are to appear very noticeable. 

In this area increased activities need' to be sparked by educa- 
tional foundations and others (a) in constructing new. measures for 
identification, evaluation, and assessment purposes,, (b) i'n basic 
research focused upon th& issues'" of acquisition, retention, and ■ 
transferability of knowledge versus transferability of attribute 
processes (talents and Skills and personal characteristics) , and . 
(c) in R / d and implementation of the findings and new procedures 
developed. - - 

As a psychologist wh'ose prime focus i^people, my overriding 
conclusion is that' Transferable Skills and Characteristics (i.e. 
transferable attributes) , is by far the most^ Important area in • ^ 
v/hich money could be' spent on education. In our own work we have 
called this approach talent-fdcused education, with emphasis .on 
the mdst important and most transferable attributes. Comfbared to 
dither approaches now available, this approach has time and again 
Produced .the most positive research evidence for bringing about a 
major improvement — even a revolution—in education. Furthermore, 
it offers a double-barrelled curriculum approach in which students 
grow both in knowledge and in transferable attributes. The product 
of syich 9h educational program is not only a knowledgeable but 
also an effectively functioning, multiple -talented (or skilled) 
person who has many resources fully activated within himself or 
herself. - Th^se multiple resources are transferable and make the 
person both useful and valuable as a citizen and highly- employable| 
transferable, and promotable as an employee . 

The funds could well "be spent in suppc^rting basic research on 
o1:her' ihtellectual and nonintellectual attributes not yet well 
* isolated, identif:^ed, and measured ,* which could- then be * 
strengthened through educational training. These include human 
interrelations, 'self insights, personal attributes etc . They 
could also be used to' develop curriculum materials apd approaches 
to cover all the important transferable talents and attribtites 
that produce highly effective persons" and emplcwees. Further 
f undoing should go to implement these mater ials ^jien they have been 
sufficiently developed for use. 

Finally) funding is needed o*n new instruments for identifying 
each- transferable attribute for measuring improvement in these 
attributes. through training, and for assessing training and educa- 
tion programs focused on important transferable attributes. 

. 

In summary; the nation should spend an extremely high per- 
centage of its current public and private funding in educational 
research, development, implementation, and measurement activities 
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'focused on multipPe transferable attributes in students . In facty 

according to all indications, the majority of the foundation 

funding in education would be w^ll spent upon attribute-focused 

education. It would not be more money down the same -old drain, 

with little' or no change or impravement An what happens to students 

in classrooms. Instead, it could bring^about major improvements: 

in all' fields of education ^nd training. ^ 

^11.. SOME -BROAD PROBLEM AREAS 

General Issues 

^ . , • ^ ^ 

This. paper will not be limited to vocational eduqation, even 
though vocational education is to be congratulated for having .such 
,an interest dn transferability. All of edyication will be covered, ^ 
with spme emphasis on. vocational education, where probably the 
highest degree of transferability is occurring within formal 
educational programs, especially in those linked to on-the-job 
performance. • ' 

The concept of transfer or of transfer of tr^|ning is undoubtedly 
one of the mo^t basic notions in education,' both m formal school 
programs and in all Hinds of learning and training situations. 
Transfer of training or the transfer of learning is highly impor- 
tant, even if limited to the formal education systeln. This con- 
cept is even more potent when .considering the kinds and' amounts of 
transfer of training that occur from formal educational systems to 
careers .and to other .(non-school) life activities.. Transfer that , ^ 
occurs, throughout one entire lifetime, such as lifetime learn- 
ing from experience^ in lifetime self-education, in lifetime tirain- 
ing and. learning on jobs, etc., isy also important. 

One of the main issues in transferability is' tHe complexity ^ 
versus the simplicity of people, jobs, and situations, including 
working condfitions and organizational climate. The more a person 
believes in complexity, the less he/she can believe in, or bet on th^ 
broadness of transf er'ability or spread Effects across all kinds 
of activities and situations. Therefore, the rtnore that ,a person 
believes in ' complexity , the less he/she expects \from transferability, 
and the more he/she feels that training shoulfl^ be £ully aimed at 

"the target. ^ v ^ , 

If little or no transfer of training of any kind were occur^ 
ring, it would be very difficult to^ defend the existence of such" ' 
a training or* educational program. It is therefore important for 
education to determine each and every type of transfer that is 
occurrirtj and to determine to what degree each education and train- 
ing program could 'be improved as .far as desirable transfer effects " 
are concerned. ■ . ' , 
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Learning and Retention Curves 

It has been said many times that education is what is left 
ov^r after or\e has forgotten what was learned in school. The 
typical learning and retention curvj sta.rts with a rapidly rising 
curvfe, turning gradually into a mor% slowly rising, "diminishing 
returns" curve. The c.urve rises less ^nd less^ with continued 
training on the same material or skill processes after which the 
learning practice in 'a training program tends to cease and the 
retention part of the curve starts to predominate. The typical 
retention curve then drops sharply and -tends- to siijk close to the 
original baseline. . * 



The .most striking phenomenon is not the amount that has been^ 
lear;ned and retained, but instead the amount that has been forgot- 
ten. This rapid forgetting process will continue to occur biit 
will turn into only a slight fading-away proceSf^fter the large 
amount of forgetting ha§ occurred. This occurs if no opportunities 
arise to relearn or to reuse what has (earlier) been learned. 

'in- later opportunities to practice or use the learned know- ^ . 
ledge, or skill, however, the. learning curve will- rise again-, ris- 
ing even more sharply and to a higher level per unit or practice 
than occurred in the initial learning. After this later period of* 
practice the retention curve. will drop again but less sharply and 
to not as low a level as the ijiitial- retention (or forgetting) 
qurve. Thus^ the more later opp6rtunities for relearriing. of 'fur- 
ther skill use. the higher the learning curve will rise and^, the 
greatver th^ retention for later use or transferability. | 

Generality Index of Transferability *■ 

In our studies of creativity one of the working definitions 
we have used ^merged from,. NASA evaluations of the creativeness 
of their scientists. The definition^ used was based upon the notion t 
that the wider the breadth * of .applicability , the greater the 
creativity- For example ^ if a scientist. on a project solved a 
problem on that project and' his/I^ entire process and solution had no 
applicability to any other project or problem, this was considered 
the lowest degree on the scale of creativeness of . the contribution. 
On ..the other hand, if a solution or a problem could be- found to 
be applicable in 'a wide range of other areas or other scientific 
pj^oblems, this would indicate a high degree of creativity. 

This same type of scale could be developed to measure a ''"genera- 
lity index" of transferability (or spread) . This index- qould be 
used to measure different kinds, facts, ideas, contributions, 
principj-es , methodology skills, etc, in termg. of their span of - ^ 
applicability. This "index" cdfuld even be applied to those per- 
sonal attributes and"" other lists presented in the first section 



3-40 

. In. 



ERIC 



above from Pratzner's report. In summary, the wider the applica- 
bility, the greater the possibility for later transferring of that 
knowledge or skill. ,.1 * ' 

Frequency-of-Occurrence Index of Transferability • 

The idea here is^ that the more frequently a skill occurs in 
schooli careeir>'and life, the more it will be retained and avail- 
able' for transfer into many of these activities^ In working with 
groups of teachers in inservice training, I have often had ^them 
list activities that adults do in their work and life. After 
they generate a long list, then they search for some skill com- 
mon to these activities. For example, skills like ice skating 
would not be used in many adult activities; however, the fre- 
quency of using a skill of balance would be much greater. In the 
lives of most adults, talking is another skill which probably 
is used more j^ten than writir^^g. . " - 

We can further illustirate why we selected the set of six 
talents f irgt "used in our Multiple Talent Totem poles. We asked 
teachers to look at a long list of activities to see how often . , 
planning talents are ^calle'd for across theae activiti^. Typi-- 
cally, we found that;' ail or nearly all of those"^ activities called 
for planning. We next raised the same question about decision 
wiaking. We few excesptions^ decision making was called for in all 
,of the activities 6n. the list, and so on. . ^ 

« This suggests that ^ach of these talents is very broadly 
applicable and would-be importaiit in terms of transferability.- 
When functioning effectively, these talents would initially make 
a person more employable upbn leaving school, more able to be 
transferred from one jab to another within an organization or - 
even across organizations, and more promotable to higher-level 
jobs. They would th^refgre be generally more useful andf valuable 
to themselves and to others. . , 

Consequently, a listing of knowledge, skills, and talents, 
according to their frequency of use in school and in other work- 
ing and living^ activities , could be studied and developed as one • 
Qf the important underlying bases ^ for predicting positive transfer 

Verbal and Verbalizing Activities r I. 

- Vocational education is perhaps -involved in non-verbalizing 
in training and performing more than most of education, which is 
both highly, verbal ^nd often calls for verbalizing as well as 
actual performance. In the latter case*, the person is required to 
learn the ^performarnce and then also describe how to accompl^ish the 
performance. . . . * • 



% It is* 'my hunch, one that could 'b^checked out by research, 
that the majority of people are both non-verbal ^and non-verbalizing 
in career* "and life activities. Even when verbalizing is required, . 
many performances, can be more non-verbal and non-v^erbalizing in 
career ^nd life activities. Even when verbalizing is required^ 
many performances can be- more nofi^verbal than verbal. Conse- 
quentj.y, the transferability of verbalizing versus non-verbaliz- 
ing performances should be studied. 

The first^ study which brought this strongly to my attention ^ 
was Lorraine. Loy ' s 1969 dissertation under my supervision. She 
foynd that after a non-verbal performance had been learned, it 
was' la^er performed more effectively than were performances 'which 
had initially been verbalized as well as performed. In that c^se--^ 
and perhaps in many nonverbal performances — the usual academic 
rule is reversed, with many educators in effective saying, tell me 
how you did the performance, then you will be able to repeat the 
nonverbal performance better later." Loy's finding could be ex- 
tre^nely important because the large majority of human perform- 

^ances are probably nonverbal {except in school) . - 

* ■ ' ^ 

The seciond study is equally provocative,' althougli it is much 
more preliminary than Loy's* It concerns itself irtore wi verbal 
versus non-verbal than with verbalizing versus non-verbalizing 
Cecelia Flint at Brigham Young JUniversity ^ just completed a study 
in 1978, the first of It^ kind that I've seen, on verbal versus 
non-verbal ';creativity. jShe tested monolingual and bilingual stu- 
dents in Costa -Rica, Who were equal ir) verbal creativity. Sur- 
prisingly to many „ educators , however, the monolingual? were more 
nonverbally creative than the ^bilingu^ls . 

_ ^ ; 

^ * Both cases above may be dealing with important pre-expressional 
thinking ^processes, most of which are non-verbal or preverbal 
(except for schooling ef fects) Whenever schooling deals almost 
solely with verbal thinking and verbalizing, other important 
pre-expressional thought processes (including creative thinking) 
may be curtailed and stifled so that they opcur with much less 
intensity and frequency than would have happened naturally. 

) ^ ^ • . 

The creative process, largely non-verbal ' and really not well 
known or understood, has been verbally described in many ways, but 
the description most relevant to this paper is presented below. 
One noteworthy feature of the creative process is that those who 
find it occurring within them often seek thereafter to have it 
oCcUr again and again throughout their lifetime, whether they are 
faced by similar or radically different types of pr6bl^ms. This ' 
re-occurrence seems to be sought after as a rewarding experience 
for the creatives . In one sense therefore it shows trans ferabi lity , 
from one problem task to another and from one time in life to 
•another.' * ^ ' 



Much of the creative process/^ for example, is most likely ' 
preconscipus , nonverbal or pre-verbal, involtring large, ^sweep- 
ing, scanning, deep, diffused, fi^ee, and powerful 'actions of; . 
. almost the whole min4.' ^ \ 

The five stages of -the creative process can be internal and 
non^expressible" in many persons until the last stage or two, but' 
even the last stage could . involve important non-verbal processes. 
If there is a sixth stage It might be the repetition of ^the 
process, later on. ^ ^ # 

III.. AREAS OF RETENTION' AND TRANSFERABILITY 

Most of the educational programs in the nation probably ^are 
primarily knowledge-focused and only secondarily skill-focused 
{or even people-focused). As has been said, one can determine the 
type of program or program emphasis by examining the nature of 
the ^esting^ in the program. Probably the largest .number of class- 
room educational programs are primarily knowledge- tested. The^ 
transferability of knowledge is thus covered, as well as the 
transferability of skills. In common language ,* these. two , when- 
eoiabined, constitute the concepts of both "know" and "how" and 
know-how is cer-tainLy a doul^le focus in vocational education. 
Consequently # one research question concerns the likelihood of • 
transfaxability^ of botii know and how^ especially if both are 
. needea in a later .activity . 

* ■ ■ -9 ^ . 

Since- so much of education is knov?ledge-^f ocused aMl knowl- 
edge-tested , i an issue Arises as to whQ.ther knowledga-f ocused 
education develops as by-products a wide range of multiple basic , 

- skills and high^evel talents of st;udents. The alternative 
question is whether there is little growth in a- wide band of the 
basic skills and high--level talents, or grow,th only in that very 
r;arrow skill band which is repeatedly used and which we have , , 
called basic academic skills., - ' , 

It is necessary now to determine not only whether talent- 
focused . education develops a wide band of skills and talents in 
students, but whether, a wide band of knowledge is developed as 
a by-product. A further question is whether talent-focused edu- 
cation causes students to process knowledge in -ways different 
from knowledge-based education, and,^ if it does, whether those ^ 
learninfg from talent-based educat^ion have -more working and last-^ 
ing kno^wledge, knowledge which is* more fully retained and more 
readily available or transfer. In other words, the question is 
whether talent-focused educati6n does a better job than knowledge-- 
focused education in fostering .growth in both talents and knowl- 
edge. ^^If it does, tlien there should be more transfer of both 
knowledge and talents in later activities. 



3-43 • .V 



ERIC IO7 



» 



Knowledge Reiention and Transferability • ' ^ " ' 

In knowledge-focused education, ' -there is a strong possibility 
that knowledge acquired in different classes will be . learned and 
returned' on tests without much.' ojiportunity to use it in later - 
courses or in out of school .activities. For example, there is a 
good chance that s.ome technical chemistry learned in a science 
course in "junior high or high school will pot be required even in 
later yeats^ of- schooling, let a-lone during the rest of one*.& life. 
That knowledge will thus be largely foirgotten or not available 
•for later use and transferability. This would also be true of 
learning to write, talk, -or listen in a foreign language if this 
language is never again used after the class if finished. It 
may slip away almost as many telephone numbers are quickly for- 
gotten after dialing^ never to be used aigain.' 

A major research need is to study the learning and retention 
curves of -the various kinds of knowledge and subject matter 'used 
in vocational education programs as well as individual differences 
in these learning, and retention curves.- These studies Should 
not merely be done strictly in research laboratories, nqr with ■ > 
nonsense syllables, but in regular classroom situations covering 
typioal subject matter. From' such curves, one might determine 
which types of knowledge would be retained better and be more 
* available for later transferability in classes or in regular ' ^ 

living activities. In this way, the various types of knowledge 
could be classified into less forgettable or more greatly re- 
usable, thereby increasing ■transferability . High fading knowl- 
edge .could then be made available through handy reference systems 
on computerized access.. ' , 

^ There may be many different kinds of knowledge, each having its 
own transferability "index." For example^ I have of ten said. that 
there is nothing as practical as real insight — and nothing as ^ ^ ^ 
■'^practical a$ no real insight. My. belief is that 'one great 
insight can be readily applied in practical situations and wduld 
have- a .high transferability index compared to an abundance of, _ 
detailed unrelated facts in a field. Research could be done in . 
different types of knowledge or subject matter to see what the 
transferability index would be with each type. - . . ' 

«* . ' " ■ • ■ 

A. caution about liigh transferability of knowledge seems 
appropriate. A new principal of a junior high started to emphasize* 
educational improvement in his newly assigned school. He had 
supportive responses from teachers in every area except orie. Thqn 
he discovered that the students in that one area had topped the 
district the previous year in the standard achievement tests being 
used district wide. Therefore the teachers in that area had some 
official justification for bei^rg' pleased with What" they were doing 
in their teaching. They were "on top of Bunker Hill" as far as 
their standing in their district, the largest district in their 

state- ' ' . ■ ' . ■ . 

, ". 
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The, principjal then wondered i^hat woiird happlki if he were to 
assemble, and ^i;etest the stjetdents who had scored 50 lii^h. He did 
' thi« and the- students* all did very poorly. This suggests, that 
knowledge .gained from -knowledge tests is not n'ecea||aiily 'retained, 

ft remind^ me of the great 'concern that J, and many otfiers 
have had about taking one final comprehensive exam over all ' 
the subject* matter they- had learn"ed in their- high school (or •* . • 
'college) courses. The- ai^ove results * suggest that thi« i's not an 
unreal fear .-' Not :nfud!i total knowledge -might bp left '£o' readily 
'display' on tests'; nor woulid *i't be e^sy 'to brush up Qrf all that 
knowHedge' in a reasonable period of time. • - ' 

. ' . .' ' - 

^ - Along with thi?" problem- is' whether~the cpmbination of know- / 
* ledge or talent may be potent. - For example, one talent , "'called 
e»pressional fluency, describes 'whether 'a person, can express • 
essentially the same idea in^ dp.f f erent . waysl If 'he/she can. It sug- 
gests* both- ^od insight and thfe ability to state arid restate' 
that insight in many ways. This combination pf knowledge and 
talent .would -seem to have a higher transferability index than the 
insight-talent combination shown by a person » when he/she reads or 
recitesP exactly , or perhaps from me"mory, famous quotations ""or 
rules or principlel. This ij\sight-talent combination is ubdoubtedly 
a ^gre^fasset in teachers, parents, ^nd supervisors'.' * ' 

■ - • f ' 

Skill Retention and Transferability 

All the above .logic o©uld apply to the initial learning and 
retentioh and to fut^-ure opportunities for re-learning, and re-using 
particular skills. The learning and retention curves for parti- ' 

■ cular skills, especially those used iii vocational education, should 
be studied and^ graphed. Of particular interest would -be whether 
a higher percentage of the learned skills is retained better th^n 
learned knowledge. That is, are typical skill learning and ^ 
i?etention curA/es different and better for transferability than 
typical knowledge learning and retention cuiq^fes? Our general 
'hunch is that they are>especially ,f or some Skills like -ridina 

•bicycle and roller , (or ice) skating. Some of* theje skills might 
differ by being well retained jj^ithqut practice, vMile others would 
require practice to be retained. ' \ M 

\ ■ 

Major issuesN are whether skills ^re acquired more easily and/or 
retained mo^e fully with more opportunities for later use and re- 
learning ^nd' A^eliher those skills would be "re.tjliined longer than 
' the Icnowledge \ypically learned in, vocational or other types of 
education'.' ' * * 
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Retention and Transferability of Talents (High-Level Skills) 

Some of the ^train^ing activities for students in voca- * 
,tional education undoubte^^ly involve a considerable use of 
lowfer l;gv^l skills, such as usin(J manual dexterity, eye-hdnd 
coordination^ working on assembly lines, etc. Others emphasize . 
higher level skills calling for higher level brain processes 
or what we have called "talents."^ Thej-e is the possibi'lity 
that both. Iqwer level niotor skills and higher level bj>ain , - 

talent could tiave higher retention curves and greater' pes- - 
sibilities for future us^ than does the knra^edge* received by . 
a high grade-gutter in school, * 

My professor, L. L. Thurston^, \/as originally a mechanical 
engineer who later obtained a doctorate in psycKology . 'One 
of his frequent complaints was that if a person is doing 
poorly in academic work , he/she is often advised to go into 
vocational education, such as mechanical training programs. 
Wien Tharstone did factor analysis studies on mechanical abilities^ 
' he found. that mos^ mechanical abilities were in the head 
rather than in the hands. All of us can agree* we want a person 
with top mechanical brains to work on our automobile or on 
- * the airplanes in which we fly. 

There is a strong possibility that the higher level b'tain 
processes or talents (such as anticipating, planning, and 
decision making) have a greater opportunity for re^-use, a 
greater frequency of occurrence in -adult and career activities, 
and a higher spread effect or breadth of applicability, than 
do sp^ecific lower' level skills or knowledges. This should be 
determined by. basic research and research in typical plassrooms 
and training .programs as well as by analyg^ing career and other, 
lifetime activities. Some have also claimed that cei^ebral 
functioning is a. person's most dependable^ servant over his/her 
life* They point out. that his/her sensory and motor performance 
may become impaired but liis/her tjrain may still be functioning very 
clearly. It needs to be determined whether lower level skills, 
subject matter knowledge, or high level talents are .retained 
and which function most effectively throughout one^s lifespan. 

r • ' ' 

Retention and Transferability o^ Personal Attributes 

In the earlier Ohio State project, the title "Transferable 
Skills" was stretched to include "Transferable Skills and 
Characteristics" and occasionally was called "Transferable 
Attributes,". This section emphasizes those other personal 
characteristics - (attributes) . 
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Cc^rtain "personal attributes may be displayed and used more 
ot ten* when functioning effectively.^ For 'example, motivation 
sparked from within to perform well might have high trans- 
ferability. Other personal characteristics might repeatedly * 
prove to be assets in dif^ferent situations and activities* 
Fpr example, persons who break easily into a catching smile 
or.^y^n into an infectious laugh can utilize that attrdbute^ 
^»in]gnyj'|ii^^es in many ways, mostly with a positive- effect. A 
p^Son 'Vith initial stai^e fright 'might break into a big smile 
before starting a^ speech, thus disarming the audience and 
gaining their support. Likewise, the ability to \5reak the 
ice and strike. up a conversation and keep it going with another 
person could be a- valuable and wi4ely-used attribute in many, 
m^ny situations, such as in door to door selling, interviewing, 
in being interviewed, in making suggestions or in giving 
suggestions or feedback.. 

The characteristic of empathy, though not yet well under- 
stood, can help establish a rapport and underst^anding between 
two people and thus should prove to have a high transferability 
index. These attributes would 'have a high frequency of op- 
portunity so "^hey could be practiced, developed, and readily . 
available for future use. 

Lack of knowledge or lack of jt)b skills are not the main 
.reasons people do not succeed in jobs. Instead, the reasons 
tend to be niore due to lack of personal skills or character- — 
istics, including personality , establishing interpersonal 
relationships , self-motivation , :self;-discovery , self -management , 
socializing and political char act^pristics | etc. 

IV. THE POTENTIAL RELEVANCE OF PREDICTIOIJ 
STUDIES TO TRANSFERABILITY 

Early research on transfer of training often stated that 
there had to be common elements between the initial training 
and the later performances for transfer to i^ccur. 

Prediction research in personnel and other programs depends 
upon the ability to forecast later performances from earlier' 
attributes, training, and per f ormances . In other words, if 
there is considerable transferability of earlier trained and 
measured aspects of an individual, then these will provide 
bases ^or predicting ' later performances . This implies there 
is something measurable from the eai^lier training that 
transfers over to produce a definite relationship. 
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* Match df Training Act ivities and Job Activities^ 

•In order to match ^ person with a job, he 'or she is 
sometimes asked to perform on tests or in classroom activities : , , 
QT^work samples. Then these, and other measures form the basis 
of -pr^idicting - later performance in some specified activity, , 
■30b, or per fornj^nce . 

, In reality, this .matching .of .the workers and the job is' •■• • . 
a double-match situation". One research need is to determine . 

• the degroG to which the later worker i-s the same person 

•as he or she who was measured earlier., The second need is to 
determine the degree of similarity between the characteristics 
of the earlier' activities and those needed in the job later. 
Possibly the greatest success in this sort of ptediction studies 
has been in predicting school grades from carliet school grades. 

The most disappointing area, of prediction has . certainly 
been in predicting adult career "and job performance from school 
performances and grades. Typically little or no relationship 
-iias been found with rdre exceptions occurring in the enter- 
tainment . fields , where campus activities are very much like • 
the lata-r professiojial performances. Thos^ who -havfe studied 
transfer of t$-aining have 'typically found little transfer 
taking place." The traditional recommendation was to train 
a person in exactly- what he or she ."is going to be called .upon 
to do.' . 

It has become possible, at least with certain human char- 
acteristics- and performances, to build parallel' forms of tests. 
One activity can thus be substituted for another activity with 
essentially identical results. It is pSossible-, for example, in 
one class with Okne teacher, that test scores on subject matter 
in later chapters in the cour'Se can yield almost parallel 
re9«lts to earlier test scores. Of course, this is true only 
if the student's effort and other conditions arc essentially 
the same . • , 

This relatively high-level of parallelism is much more , 
likely to occur in schools than between schools or jobs or ^ 
between jobs and other jobs. It is no doubt troublesome to 
educators to hear that school grades are such poor predictors 
of later career performances.' In' fact, this has sometimes 
been called tlie best guarded secret in education. This lack 
of predictability is undoubtedly Isss true of vocational educa- 
tion programs than those programs offered In general education, 
graduate education, and even professional education. 
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It is undoubtedly even more troublesome to epuciators, 

find that nifeagures of 



especially- curriculum, specialists^ tio 
students' extrar-cuVricular activities are bettered 
tors than grades. One partial explanation for tifii 
*of common elements between school activities anc^jf W( 
afctivities,. To illustrate the problem, if ten qr^ 
^,ables are involved in the training activity and Isx 
only one or two of ^these ^'re ^transferable to th 
jpb activity, these two- variables cannot; predic 
transfer very potently to ^ the later situation ajfia 

When studen*ts are consi'der;ed merely as clajss 
of knowledge, they are learner s-and-re turners, 
wdrking undet close supervision and^ directidn* 
dents asked •'where can you^earn A' good salary : 
of-work by telling ^your ^ss' exactly what h0 hi 



eer predic-- 
is a lack 
rid of work 
ore vari^ 
uation- and , 
re ccanplex 
ighly or , 
performances. 



oom learnejfs 
tinually ^ ' 
e of my stu- 
jthe world'- 
Itold you?^ 



^ This lack of correlation between schob^ a^d world of work 
Tperf ormances also, suggests that the pers6n '^ndi^ ^ijtuation may 
be as different as the activities and the testis jier formed. In 
fact, one of the frequent statemen't^ among ;^rsona doing pre-- 
diction studies in personnel work is/ thap piere^ is a cei-ling 
to the leVel of correlation found in prediction studies match- 
ing workers and jobs. This may be because^ vjpriables other 
than those concerning the person or the wo|:ki activity are not 
controlled or used in the prediction equat^^TH. 

Triple Match of Person, Job, and Situational- Variables 

in our first major attempt to use working condition vari- 
ables as a predictor of job performance,! we studied the 
productivity, creativity, and other accomplishments of "scien- 
tists on the job in a large research center in the San Francisco 
area.* Surprisingly we found many multiple correlations of .5, , 
. 6 and ever\ .7 between laeasures of the working climate of^ 
scientists and indices of their individual performances,* sug- 
gesting rtfhat a three-way match is needed. This is actually ^ 
three-waV dc^ble match between the person at two stages, ^ the 
training ve^rabs the job, and the training situation versus the 
job situation. If there are many mismatches, ther>e will be 
low correlations at best, indicating low transferability. 

If the .focus in edi^ation were on human characteristics, 
it would be possible to develop many valuable attributes, but 



*An Investigation of Organisational Climate. Robert pllison, 
Blair McDonald, Lawrence James, David Fox, and Calvin W\ Taylor, 
Published by Creativity Research Institute, .Richardson Foundation, 
Piedmont Building, Greensboro, North Carolina, 1967 pages/\1968. 
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they may n4^er be needed because pf the absence 'of both appro-^ 
priate situational variables and appropriate performances in 
working situations. Stated in reverse, the attributes being 
trained in the educational settitig may not be those called for 
in the work ^tuation.^ 

. Curriculum specialists, in vocational and other educational 
programs can establ:fsh appropriate situational variables, and 
a^so prescribe the activities to be performed in the earlier 
learning arfd training situations. They can also try, to pre- - 
scribe how to elicit certain skills ^ talents/ and other human 
characteristics, as wel^ as outlining what knowledge is to be *' 
acquire(;J.. Then the student may liave, enough of the necessary 
combination of know-how to function effectively in the later 
activities. This "total curriculum approach" could more 
nearly insure the greatest prediction^ or transferability effects. 

The research suggested here is mpre a matter of defining 
the full target^ together with clarifying and measuring the 
3ttribi:\tes involved^ the- human performances, the situational 
variables in the climate or working conditions, and the vari- 
ables in the iob or performances. These need to be . reduced 
to a workable number of variables in each case, by singling out 
the most general variabl^^s f or"^ the greatest attention , and those 
variables used most frequently in accomplishing tJie most effective 
transfer (or prediction) from an earlier to a later situation. 

Measurement of Climate (Situational) Variables ^ 

' — — ' ■ — ■ ' r~ • ^^^^^^B^^^* 

Our measurement research has yielded a Student Activities 
Questionnaire (SAQ) for classroom climate and teaching process- 
es therein plus a Management Audit Survey (MAS) for use in 
large organizations.** Situational complexity is indi-cated 
in our MAS ' f indings- by tnqre than fifteen organizational ^::limate 
scores (all involving different- factored dimensions) . Thus^ 
if one were, transferring from one situation to another/ the 
climate variables could support transfer effects if enough, 
variables of the situations are identical or similar, but could 
be quite damaging if many or most of the variables have changed 
radically from the initial situation. 

AriothGr- mail) finding* is that in a large organization with 
many subdivisions, the climate is not at all uniform, but can 
change considerably from one sub^-unit to another. Just as 
intjividuals differ, so can organizational sub-units differ in 



**These are available from The Institute for Behavioral Research ^ 
in Creativity, 1570 South 1100 East, Salt Lake City, Utah 84105. 
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all the measures we have takdn. One example of our findings 
is that in a sub-unit where . the climate for innovation is 
high, the training costs are low because the ^^nnovative people 
can figure better and betters ways to do things. ,In contrast, 
where the climate for innovation is low, the training costs 
tend to be high because '^everyone must be trained in the offi- 
cial way". V >^ 

Another example of tjie effect of %he working- climate iipon 
a pejTSon's performance is illustratrei in athletics, where a 
player can- get traded to a different team and Work unde^r a 
different epach ^d different ^organizational policies and, con- . 
ditions. Some players, when traded, suddenly bloom^ especially 
when playing against, their formed team. 

V. SPECIAL PROBLEM AREAS 

Transfer from Training to Tegting / ^ 

* Another kind of transfer of trainijjg dcpurs when attributes 
displayed in day-to-day .elassroom and homework activities are 
displayed on class tests. Other variables^, though, such as 
test taking anxiety, can act to prevent a close relationship - 
between classroom training performance and' periodic test per- ^ 
f ormance . ' ^ 

Another corjcern is whether test performances in school will 
correlate with what may be considered test performance on the 
job. Our lengthy experiences Hn large testing programs are 
that school tests will hop correlate highly wiljja on-the^-job 
types of tests. Most people who build tests are academic pro- 
ducts and know' how to bui^ld academic tests. When I ran the 
Army-Wide Trade Testing ^^rogram, ye gradually learned how to 
construct tests so that they become mor.e^and more job-like 
instead of school-like. On the tests we' required functioning 
to be job oriented in job-like settings* We also produced ite^s 
and procedures that were less verbal than those on the usual 
school tests. . ' • 



Later I directed a new/ type of project for the Air Force 
entitle^ Training Needsj Tests, which yielded a profile of scores 
on subcomponents ^of each of several technical Air Force jobs. < 
For a person to be an airplane mechanic or other specialist, 
he had to score above the minimum on each and every part of the 
test profile. In this jway we' discovered in which areas he 
needed more training in order be fully certified. Again, 
we were able to produc^e tests whrch were job-like rather than 
sci^ol-like. It was lound, however, that because "the tests 
used for promotio2>-in the Air Force were more school-like than 
job-like, the Training Needs Test Program was seen as a threat 
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to the well^-established program of tests "used for .promotional 
V purposes^for qjilisted^ personnel . We ssuggfested that all of these 
promotion tests should be revised to beccpe more job-lik^ and 
therefore more sound. 

From, these experiences educators are in'a position to pro- 
vide- the know-ht)w in training manuals\and to explain how to 
build job-like '.tests for use in schpois. If these tests were 
used and if cdassroom training perf orsiances st^ll did not 
transfer over well to the job-like tests, it would bp evid^ent 
that the Qslas-sroom perf ormancesVr^equire change so that positive 
transfer oould' occur.' ' - . ' 



. Self Educating and Leai:ning^ From Experienced/on One's Own 

■ ] 7 ' ~. 

Learning how to educate oneself could be th« most impor- 
tant of transferable skills or talents. In a way it is a fill- 
the-gap talent. When all transferability that will occur has 
occurred and a person is still not capable of functioning at « 
the desired or required level of performance, Iie/she is often on 
,his/Jier own. fe/she raust train or educate- liiioself /herself for the 
regaining requirements of the job through practice, self evaluation, 
self guidance, etc. Since the correlation is often low between 
training performances and job performances, those who excel rn 
the latter tend not to be those who are earlier teacher-pleaser * 
grade getters, but those who have educated themselved on the 
remaining aspects of the job. Self-educating could therefore 
be one of the most potent trainable skills or talents involyed 
in all potential transfer situations. 

.One negative example here is our evidence that medical 
students who were the hdghest grades getters and thus possessed 
the most knowledge at the time of each test Were not necessar- 
ily those who were most knowledgeable after graduation. Every 
ten years general medical knowledge almost doubles; The stud^ ' 
skills used in obtaining grades in medical school, however, do 
not transfer suf f iciehtly to become the skills used by practic- 
ing physicians to ke>ep abreast of knowledge during the follow- 
ing decades. Those who discover how to learn most effectively 
on their own, and not those who once got high grades in college, 
will be the ones who remain most knowledgeable. 

Awareness or Reality Training About Transferability 

Experiments ought to De conducted to determine what merit 
and what effects there would be if students were given direct 
awareness training or "hard reality" training about all the 
topics on transf erabil ity 'covered herein , This could include . 
educating themselves in' areas where much, if not most, of the 
later performances would 'not be taken care of through 
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'transferability of earlier training; thus, they could not 
expect, to* lean too heavily on their past training or educatj.on 
for full future success. They could also take' awareness and. 
reality ' training on their own complexities; on the complexities 
of their future activities. As a result of this transferability 
awareness, they, might' see the merit of getting experience jLn 
a wider r^nge of pe^rSonal attributes and worKi^g conditions • so 

^ tjia't;^ they could prepare themselves for greater transferability, 
great'er value^, and greater likelihood of promotibnl 

A To illustrate this ned^^for direct training on "transfer- 
ability, I use the example of an Army Engineering Training 
Progra^p, which trained Army engineers to- build a bridge across a 
stream flowing into the large river nearby. Later, when these 
engineers Went into action in war settings> they were able to 
build an appropriate bridge as Iqng as the stream was as narrow 
or narrower than the stream where they were trained. However, 
many were unable to build'^ a bridge across a wider stream***^ 



N 



***Readers might want to l^>e informed of the Project on the Voca- 
tional Preparation of**Gifted and Talented Students in Secondary 
and Post Secondary Education. Dr. Bruce G. ^Milne was the "Project 
Director at the School of Education, University of South Dakota, 
/^rmillion, South Dakota 57069. In a series of conferences 
across the country 'he gathered together leaders in vocational 
education, vocational counseling, and Gif ted/T^ented programs,* 
plus consultants (including the present writer), to explore all 
aspects of the ttjpic of the project. 
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COMPETENCY-BASED VOCATIONAL EDUCATION ^ NEEDED RESEARCH 

^ • ^ William C. Kna^k 

The "Competency-Based Education Movement", which has been 
described' as "a bandwagon in search of a definition", ajpeats. to be 
here to -stay. Con\petency-based vocational education (CBVE) has 
also received^ broad attention in t|ie literature sinoe 1970, but 
there appears to be a lack of commbnality among authors in their 
use of expressions -and *terms associated with CBVE. For example, 
the definition of "pai^ticipants" in CBVE ranges all the way from 
a typewriting teacher vho has .djeveloped his/her first task ot' 
competency list to vocational-technical institutions which , are 
totally competehc^-based, open entry, and wh'ich utilize personal- 
ized instruction. These extremes and the, no^ doubt, many levels 
of definition between them suggest three areas of possible basic 
research in CBVE: 



(1) Research to obtain reasonable concensus as to the 
characteristics of CBVE (definitions and linguistics) . 
A survey of knowledgeable persons^is recommended, 

(2) Development, or refinement of an instrument which can 
be applied to vocational program (s) *or to' an entire 
institution to determine at what 'level the, basic 

/ characteristics of CBVE are present. R&D could 

involve further exploratory work along the lines being" 
' developed by Keene State University in New Hampshire. 

■ ■ . ' \ ' ■ ' ' " ^ 

(3) Utilizatiot) of the instrument to determine the levels, 

; of CBVE present in vocational programs and institutions 
\ around the nation. Application of the instrument to 
\ on-going CBVE programs is recommended. 

CBVE prograSimiiig is frequently co-mingled with personalized 
■ instruction, individualized instruction, time-variable learning 
and mastery learning. Must it be? Research is needed to' answer 
the following question: • 

(4) Can CBVE exist successfully if it is not associated 
with (a) personalized/individualized instruction?, 
(b) time-variable learning?, or (c) mastery learning? 
Opinion polls from successful and reasonably complete 
CBVE programs and institutions would be of value here, 

»■ . ' • 

The question of "why CBVE?" has not been adequately ad- 
dressed. There are frequent references to "a bandwagon^', "state 
mandates", "accountability", and "innovation", but little 
reference to it bei^ng a superior learning system. Is it? 
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■ - . ' ■ 

At the 916 Vo-'Bech Institute in Minnesota, a pei^sonalized 
competency-based program was origi^nally initiated for educational 
managementr reasons, - In that program^. 

1) . students areJ not required to repeat learning of skills 

and knowledge previously learned, , ^ ' 

2) Handicapped and other student^ can obtain immediate' 
access to instructional programs. . ' 

,3) Handicapped students can complete - the segments qjE an 

instructional program they are able to, ■ . ' ' 

4) The building, instructional eqiliipment, and instructional 
st^f f can be used more efficiently- There is job place- 
tnent assistance for graduates, 

5) .Students .with a wide range of entry-level skills can 
be accented, ' - • 

6) Instruction is available 24 hours per day for part-*day * 
students! . . 

Xiater, the pro.gram was also defended for the following edi;- 
oational reasons; . , 

\ 1) The learner progresses at his/her own rate to master 
the instructional content. 

2) More learners achieve mastery than ds possible under 
^group-centered instruction, 

^ ^ *, 

3) The learner builds confidence by^ succeeding in learning.' 

4) The students learn' to help each other learn rather ^t^jpan 
' to compete f ot grades , 

5) Learners/may speed up their learning, 

6) The presentation of the content is consistent. 

7) Students can learn accordirig to their preferred learn- 
ing style. 

8) The efficiency of the instructor is increasec^. 

9) The instructor perfonj^s as a manager of learning - - 
rather than as infc^rmation giver. 
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p Research is needed to" ascertain: , ' ' - 

' • ' ... < . 

(5) Axe the reasons being given' for introducing ^CBVE va^lid? 
^ • - Objective on-site research is needed to determine* if 
^ \ . claims have validity. • . ' " * 

\ (6) Wh^t reasons would motivate vocational education 

administrators, vocational teachers and persons in 
\ state depaj^traents of education to ^implement CfiVE? lA 

^ . \ survey approach is needed for this information. 

.... .. . ^ . ^ . ^ ^ . . 

4 (7) What is the current level of coimhitinent to CBVE by: 

state departments of education, vocational administra- 
tors, and vocational teachers? Confidential surveys 
are needed. . 

. , /■ ,• , . ■ , 

^ ^ ^ Efforts have been mad^ at the National Center for Research 
in Vocational Educatios-^t Ohio State University and elsewhere 
to identify competencies refc[uired for' teachers to implement 
CBVE. However, methodology for how to teach these competencies 
is still .elusive, a K^ the time for learning the competencies. 
Even more elusive is^B^b time th^ teacher needs to implement 
CBVE. Estj-mates on^Ji^ration time for CBVE student learning • 
■ ' system ranfcfe^from 1 development hour per foUr student instruc- 
tional hours to 50 development hours for one student hour. Even^ 
tlie lowest estimate seems prohibitive. It has been reported 
that 75% of vocational teachers felt that they had less than 

/ three hours a month to develop, adapt or lo'calige curriculum. 
Research is needed^ to determine: 

■ ^ ■ ^. (8) What Was the development time commitment in success- 
ful CBVE programs? Variables: Programs- developed , m 
from Hscratch", adapted programs, etc. Existing on- 
goin^^rograms should polled. 

(9) What is the success of "adaptation models" (transfer 
programs from successful CBVE sites)? (Wgoing 
adaptation models should be monitoted. New well- 
controlled models should be tried and monitored. . 

(10) What transfer techniques work well (from successful 

CBVE transfer sites)? and what works less well? This 
, is a variation from (9) above. 

"CBVE is claimed to have some advantages over traditional 
instruction in the training of handicapped, disadvantaged, and 
, ^ for encouraging sex equity in programs. If true, CBVE could 
have a strong impact in implementing the"'' objectives of federal 
legislation. Research is needed to: 
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(11) Test the; validity ofyclaims about utilizing CBVE. to 
improve the i-xaijoipg^ of persons who ^re. handicapped , 
disadvantaged or taking ^t^aiping courses traditional 
for one sex. On^go'ing sites should be ^studied to 
see If delivery services to handicapped persons are 
improved with CBVE. • . ' • , 

Cost data about CBVE are almost, nil. . Research is ^needed, to: i 

(12) Define start--up costs on a per *instructi6hal .hour 
basis and. to compare "these coasts to* stcirt-up costs*" in 
a traditiol^l program. THis ibpl^ies s^tuclying new find 
on-going programs on-site, ' / ' - . 

(13) Test cost advantages/disadvantages as compared to - - 
trad^itional- instruction in on-going instructional 
programs. Same as (12) above. 

' Little is known about "predictors" of individual student " 
success in CBVE .programs . Research is needed to: \, ' ■ 

(14) Determine if there are -any '^^predictors'' -of probable^^ ' 
student success in a CBVE ^program such as past exper- 

. * iences, standarized tests, cognitive 'style mapping, . 
etc; and^ 

(15) Determine if there are remedies which can be utilized 
with students of low probable success to improve that 
probability; Questions (14) and (15) imply institu-t 
tional research at CBVE sites. - 

Wher^,\C,BVE inst;ruction has )been personalized or individual- 
ized and u^d with a mastery learning approach, it is claimed 
that graduates . taught in this manner- tend to- attain accelerated 
advancement , on the -job because of having .learned "how to learn". 
Research is needed to : , - 

(16) Test the validity of CBVE "advantages" to students 
a^ter they are employed. This could be an add-on 
to existing follow-up studies. 

A major. thrust for attempting to implement CBVE throughout 
the country has been ,made by state departments of education and 
teacher training colleges and universities encouraging vocational 
teachers to implement CBVE programs in their sch6ols and insti- 
tutes. Research is needed to: . . ^ ' 

(17) Determine which approaches have been most successful 
in implementing CBVE. A natioVial survey would be in 
order. 
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Some state departments of education have decided that 
horizontal and vertical articulaiion of vocational programs, x;an 
be accomplished most effectively if competency-based .programs 
are established first. Research is needed to: 

(18) Ascertain' t)ie impact of .CBVE pn th6 articulation of 
vocational instruction. Same as (17) above. 

There does not seem to be much, data available on studeht 
opinion of CBVE. Research is needed to: 



* (19) Determine student attitudes' toward a CBVE system ot 
instruction; pre and post-test. (This would require 
institutional on-site research. ) 

(20) Determine helps/hindrances to students in CBVE 
system. 

• 

. Most CBVE instructional development starts with obtaining 
some types of task or competency ' list. This is followed by the 
writing of terminal performance objectives and standards for 
V those objectives. Increasingly, previously developed lists 
Y*— V are being made available for adaptation by others. Resjearqh 
is needed to answer the following questions; 

(21) Is it possible to have a national task list with 
standards for an occupation (i.e. Auto Mechanics)? 

(22) If national standards can be developed, will this 
lead to a nationai, curriculiim? Is this desi»able? 

(23) Are the{:e advantages/disadvantages to the -.various 
models of CBVE now being used in different parts of 
the country? • 

(24) How- are CBVE learning materials now kept updated^and, 

(25) ^s this, .possible with a national curriculum? Questions 
^ (21-25) above could be researched with opinion polling 
' 'of persons familiar with CBVE. 
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DATA COLLECTION IN VOCATIONJ^L EDUCATION 
Joseph F. Malinski 

The tejrm "data collection," as used here, involves all the 
activities associated with the identification, definition, class- 
ification, recording and reporting on, about, or in vocational 
ecucation. Data collection processes span word of mouth trans-" 
mission to complex au^mated informat-ion storage and retrieval. 

In my opinion, research and development in vocational educa- 
tion and all of education .for that matter, have concentrated to 
a large measure on the research report or dissertation model of 
data collection and analysis. The cbntinuing use of this model - 
has hindered the development of real time information systems as 
tools for research. _ Another impediment to the use of real time 
information systems in education can be described as' the "compli- 
ance 'mentality" associated with reports directed upward in the 
system; very, often requested reports had little relevance or. 
utility within the unit being queried. A final h^indrance is the 
tendency to develop data collection efforts for policy making, 
institutional plan-ning, operational control, and evaluation of 
• all types. To use^ the vernacular, the ntain thrust of research 
and development activities i-n vocational education is to figure 
out "how to get our act together." 

In its report on the hearings for the Educational Amendments 
of 1976, the House Committee on Education and Laibor reported in 
the section titled "Administrative Improvements." 

The Committee belieyes that increased Federal 
^ . funding will lead to more and better vocational 

courses. But simply putting ir.ore dollars into 
vocational education is not the sole answer to 
the question of how to achieve the best voca- 
tional education programs possible. 

« 

There must also be major improvements made in 
the way in which the program is now administered 
by the U.S. Office of Education and by the States. 
Testimony before the Committee showed that these • 
improvements must come in the areas of planning, 
accountability, data collection and use, and > 
evaluation and follow-up.* 



* The Vocational Education and National Institute of Education 
Amendments of 1976. Reports No. 94-1085, 94th Congress, 
2d Session. Page 16. 
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This legislative activity resulted in Section 161a of the 
1976 Act which requires the developirent of a national educational 
data, reporting and accounting system. Therefore ^ the Education 
Amendments of 1976 provides a mandate for the development of^a 
National Vocational Educational Inforiration System. This mandate 
is the first time that a national system including all states and 
territories in the nation has ever been attempted. The importance 
scope, and magnitude of this national effort will have a signifi^ 
cant and lasting effect on vocational education and the national 
Economy, The design, development and implementation of 'the 
system will provide many opportunities for .research and develop- 
ment activities in data collection, processing and reporting, 

^ Section 161b addresses the need to relate the process data 
identified in Ifila to labor demand. 

The development process of the national vocational education 
data and accounting system can be divided into the following 
segments • 

1, The development of a conceptual model. — ^ 

2/ The identification and definition of the data elements 
required for the system. 

3. The establishment' of an accounting syst||m. and .structure, 

4, The development of the operational process and 
porocedures for data collection and storage, 

5^ The design and development of the reporting 
capabilities of the system. 

6. The evaluation of the effectiveness of the system. 

7, The improvements and/or enhancements to the system; 

A Concept of a Uniform Acc ountin g Structure 

Figure 1 represents a conceptual presentation of the^ record- 
keeping (accounting) system suggested by Public Law 94-482 and 
related acts. Inasmuch as the primary focus is on vocational 
education's effect on student performance, the implGinentation of 
the model will need to be concentrated at the local level - 
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CONTEXT 



Figure 1. Schematic model of dat^ required by 
Educational Amendments of 1976 * 



* From paper pifepared by V?illiam A. White and- Joseph F. Malins^ki 
for the Vocational Education Task fierce Data Acquisition Sub- \ 
committee; CEIS Annual Meeting*, Washington, D.C. April J 8-21 J 
1977. . . 
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The Education Amendments gf 1976 represent a watershed data 
collection effort. Sections 112, 161 and 523 - among others - 
focus on .the need for identifying, defining, classifying, record- 
ing and reporting uniform data about students, programs, V^^og^^m 
completers and leavers, staff, facilities, and expenditures. The 
extensiveness of^ the efforts required to meet the mandates of the 
legislation will necessitate a well-formulated, highly-structured 
accounting and reporting system to ireet the needs and demands' of * 
individuals, local administrators, state agencies and federal 
■ agencies. This legislation also requires data linkages with spe- • 
cial education, vocational rehabilitation, CETA and general 
education. 



Requirements of a Logical Construct 

To comply with legislative requirements it will be essential 
to engage in significant changes relative to the information 
gathering, organization, operation, and administration of the 
education system at the specific levels of program implementation 
— individual, local institution, state agency, and federal agency 
A data base will have to be developed which is complete •-- in 
terms of accounting and reporting requirements ' — and which, has 
the capability to generate analytical reports actually aiding in 
decision making and policy formulation rather than simply provi- 
ding collated data- and status information. In addition, it will 
be necessary that the data base be generated for analysis in such 
a format and suf fi'ciently . accessible that updating the informa- 
tional fil^ can be accomplished at regular intervals. (At the 
local' level it would be preferable that it be. possible- to do this 
continuously.) 

Accomplishing this will require a logical construct developed 
through a model which is comprised of integrated data sub-systems 
with student, personnel, curriculum, finance, property, and com- 
munity information. The modularity of data between sub-systems 
^ will be critical because it must be possible to generate output 
using data across two or more of the ' sub-systems when information- 
al needs demand this capability"^. For instance, information needed 
to make decisions about specific aspects of the education enter- 
prise (e.g. ,• students, personnel, etc.) at the individual or any 
of the tfhree governmental levels (local, state, or federal) will 
be a function of the educational context within which the decision 
is to be made (e.g., policy, goals, process, etc.). Therefore, 
the actual control and utilization of data will be a function of 
the ability of the accounting and reporting system to interface 
data elements across data sub-systems at a given level of educati- 
onal operation and within a given educational context . 
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Figure 2 presents a display of a conceptual organization of 
the manner in which information about a, particular program can 
be organized for access for different levels and purposes* 
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Figure 2.. 



Organization of an integrated data base 
for local management purposes. (File 
structure used in Joint Independent School 
Districts No. 287, Hennepin Technical 
Centers, 1820 North Xenium Lane, Minneapolis, 
Minnesota. ) 



., , Many people within vocational education are involved in the 
production, recording, reporting or utilization of data and infor- 
mation. The scope and complexity of vocational education require 
a comprehensive, integrated, information system. * 
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The system contains the following characteristics: . ' 

1. It is made up of six major sub-systems: Students, Prog-- 
rams. Personnel.,^ Property, Finance, .Community. 

2. It establishes standardized data definitions. 

3. It structures the data accounting functions witHin each 
sub-systejn to enhance th^ reporting capabilities of the 
system. 

4., It provides an improved method for data assembly, ii;put 
preparation,, verification, validation, and reporting 
resulting in the more efficient production of accurate 
apd more clearly defined infonr.ation. 

5. It utilizes an integrated data base that makes possible 

the correlations of information among sub-systems and 
* organizational units. 

Figures 3 and 4 illustrate the interactive and reporting 
capabilities of the system. ' , , 

The complete installation and effective use of an informa- 
tion system has the following conditions and requirements. 

1. It requires that those persons having operational admin- 
istrative or managerial responsiblity within, vocational 
education understand' and fully utilize the system with 
its present capabil^ities and assist in the fuorther devel- 
opment and improvement of it. 

. j ' 

2. It identifies and describes types of operational and 
management reports which will be available to document 
the vocational education performance, 

(Figure 5 illustrates the conceptual scope of management 
reports . ) 

3. It outlines the major activity areas involving the many 
producers and user§ of inf orm.ation within and outside 
vocational education, showing the specific data items to 
be recorded or reported, the person or persons responsikjle 
date, time and sequencing requirements, and relationship 
to other systems or sub-systcir.s . . The overall implementa- 
tion requires a major effort by the National Center for 
Educational Statistics, BOAE, state departments of educa- 
tion, local educational agencies and many ot-her national, 
state and local organizations, both public and private,* 
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Figure 5. A conceptual scope -of management reports 
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4. It requires identification ofi the processes and proce- 
dures to be included in the ix^tegrated information system. ' 
This activity will require the analysis a^d evaluation 
of current procedures and restructuring and reordering of 
them where necessary. - ^ 

^ . V 

5^. It requires the development of a plan to disseminate 

effective utilisation techniques to the information sys- 
tem for the management of vocational leducation, ^ 

- 6. It identifies costs necessary to design, develog, maintain, 
implement and improve the information system* 



Management Information Systems 



Certain propositions can be suggested for consideration in 
the development of research and development efforts in data 
collection and ,use to support a real time information system for 
vocational teducation. Nine are presented below. 



3. 



-excision Making Information. There is a greater need 
for decision making information at the local level than 
at the state or federal level as more decisions (at least 
numerically) are or should be made locally, Furthermore, 
*the information reported to the- state and federal levels should 
bear some relationship to the information necessary at 
the local level. Requiring data whose sole use is for 
reporting to higher levels should be minimized. 

Decentralized Capabilities. There is a difference be- 
tween decision making information at the locals state, 
and federal levels. The level of detail necessary to 
make decisions or evaluate previous decisions is natu- 
rally much more detailed within , or between departments 
and within or between school districts than need be re/- 
ported to the state. ^ * i> . 

Moaularity of Data. As reporting is simply a summatioM 
of a large number of individual chai'acteristics, statuses, 
events or transactions, it. is important that ea6hi con- 
tain adequate information that can be related to more 
than one activity. 
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standards 6f Uniformity. There is a niaed to define each 
data"^ Slement at each level in terms meaningful to the 
individual providing the data. As the operations and 
program characteristics of vocational education change, 
the data collection and analysis system must reflect 
those changes. , - ■ ■ ' 

Basis- of Accounting. The objectives of an accounting 
system are to relate the^ inputs and outputs for an ac- 
counting period and the current status of the program/^ 
service or activity with a reasonable amount of accu^cy. 
The rules established should, also present fair and ccSm- 
parable analyses. 

Involvement. There is a need to actively involve those^ 
affected by or having an interest in data collection 
aetivities, both providers, and users of data. Following 
this, greater under st'andinig of the need to integrate 
and consolidate dsta -^"collection efforts could be achieved. 

Organization of Data for Cro'ss'-Functional Analysis {THE 
CRII^ICAL PROPOSITION) . There is a greater need for 'the 
correlation of data and information across the identified 
sub-systems, e.g. Student suio^system to Finance sub- 
system; Student sub-system to Finance sub-system to Per- 
sonnel sub-system; Finance sub-system to Property sub- 
system to Curriculum sub-system. By linking 'the various 
sub-systems it would be possible" to identify the resources 
of personnel, property^ and finance used by a student to 
achieve a measurable amount of learning 'witliin 'a specific 
time frame. Ther^ is a need to set the same parameters 
of timeframe definition arid structure for all of the 
information sub-systems. 

The Report-Back Capabilities. The output of one level 
or "function within the, information system serves as the 
.input to another level or function. There is a need for 
input level verification and validation of data and, 
where data are collected at the state level, from a 
large number of umiformly defined organizational units . 
(districts, institutions,' schools, programs, classes, 
individual students) . The pollecting organization has 
the capability to report back .meaningfAil comparison 
analysis to the data-providing informational unit. 
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9.. Changing Nature of Data Collection Needs Within the 

System (Flexibility) Changing legislation and funding 
patterns, changing programs and organizational structure 
within and among educational agencies, shifting popula-- 
tion and employment pattern^, and other constantly change 
ing needs present' data collection and reporting difficul- 
ties for vocational education. 'Structuring data collec-- 
tion efforts separately for^ each new need should be 
minimized. • , 

The process of implementing these proposals in whole or part 
will of necessity need to be evolutionary in nature and will re- 
quire the continuous involvement of the research and development' . . 
community . ' . • " 

VQcat!§ibnal Education Data/Information Problems and Issues 



Problems are identified in four major areas including, 
coordination and comprehensiveness; goal and policy formatir^n, 
monitoririg and, evaluation ; involvement in vocational education 
data collection; , and the chariging nature of the system. Flowing 
from each of these problem areas are a series of issues which 
must be addressed in establishing alternative structures for 
dealing with research and development activities concerned with' 
data and informatiory the major issues are listed under the 
relevant problems or areas: ^ " . 

Coordination and Comprehensiv.eness 

1. Can' a single coordinated structure, at whatever level, 
meet the data collection needs of all the constituents 
and clients to be served? If so, how? If not, why not? 

2. fjhat mechanisms can be developed at. the local, regional, 
• . state and/or federal platining levels to influence and 

deal .with ^the federal and state data collection programs? 

3. How ca^v* private, semi-private and special purpose data 
collection and activities be furthetv or increasingly re-- 
lated to the public data collection f3rocess?, How? 

4. Mow can resources for vocational education data collectj^bn, 
, functions and activities be allocated in a comprehens i\^e 

-fashion to meet priority needs and equity considerations 
of various geographic areas? , 
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5. Kpw can data ■collection -overlaps , duplications, and gaps 
in services be detected and managed? What is the . appro- 
priate data cal'lectioji mechanisir. for comprehensive coor- 
dination of services and programs? 

6^ How can services and facilities be pooled or centralized 
to yield more comprehensive data needs and to decrease 
costs? ~ " . • . 

7. What inter-agendy mechanisms are needed to coordinate 
vocational education data collection with other criti- 
cally related' data collection ateas? > " • • 

• ./ , - ' ^ . . 

Goal and "Policy Planning, Monitoring and Evaiu^ipn 



1. Should goal .and policy development be .coordinated at the 
local, regional, state or federal level? Is the existing 
mechani,sin at'tjie federal level Sufficient for cc*i*dina- 

-"tion? Ifr not, what is an appropriate me,chanism?' Can 
separate local policies, goals, and priorities be recon- • 
ciled into a comprehensive set of 'priorities'? How? 

2. What is an appropriate mechanism for identifying the 
unmet needs? For identifying future needs? For recom-' 
mending new data collection components and policies to 
meet these needs? ' . 

3'. How should capabilities for monitoring and evaluation of , 
, vocational education data collection and services be 
■ improved? Can p,erf ormancfe indicators for each of the 
major functions of data collection be identified? What 
mechanism can put the improved cajDability to use so that 
monitoring and evaluation is made * comprehensive and con- 
tinuous? How can monitoring and evaluation be related to 
resource allocation so that ineffective data collection 
areas are identified and dropped? ' ' 



Involvement in Vocational Education Data Collection 
- ' * 

1. How can student and employer representation be increased 
in all vocational education data collection activities? 

2. How can a planning structure be developed to prepare 
parents, students and teachers' and provide them necessary 
information for a greatly expanded role in vocational 
'education data collection and decision making process? 

I 
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.3. What is an appropr;iate means to identify problem areas 

needing further study? Is there one or are there several 
agencies better equipped to perform thase studies? 

; 4'. How can . exist::^g data/ information, and special studies 
be gathered in useful form and disseminated to all per- 
sons and agencies th^t may be able to use it? , What 
•mechanisms can insure -that it is utilized by all those 
developing policies and making funding decisions for 
vocational education data collection? 

„ / . \ 

, The (Changing Nattire of the ^System and the Needs to be Met 

1, How can changing aeeds for vocational education data 
collection services be . addressed? Kow T:an the range of 
thp mix of school preparation and on-the-job, in-service 
"training be documented? Kpw can the shifts in employment 

•* , concentration and skill content be addressed? 

2. Kow can a decentralized and representative data informa- 
* tion 'process exist within' a structure for resource 

allocation in which decisions are concentrated with state 
and/or federal officTaXs? What niechariism ^ is appropriate 
to monitor the process?^ ^ ^ 

The problems and issues listed above should provide a base 
for the development of specific research and development activi- 
ties /and the following suggestions list certain methods of 
research which might prof itably ' be used: ^ 

1, >Joint investigations (consortia) of students, teachers 
and administrators in schqols or school systems and re- 
searchers based in universities , state departments of 
education, the U.S. Office of Education, and/or other 

.outside organizations. • 

2 . Researc*^ synthesis and concepjbual development in advance 
of preparation of project memoranda. 

3. Longitudihal studies of- organizations' dynamics, of the 
relations between stim,uli and vocational education organ- 
izations ' respdnses to them, " , ^ ^ 

4, Exploration of different metaphors , Vuch as production 
process control and market analysis, as the analytic 
frameworks. 
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Historical studies to find out how features of vocation 
education programs have evolv^; e.g., how roles of 
vocational educators as data collectors have changed or 
how criteria for evaluating vocational education's per- 
formances have shifted. 

Investigations using media , such as video tape, audio 
tape and film as research tools for data collection. 

Re-analysis of existing data using novel concepts rathe: 
than coliecting new data. 

Investigations as to the most effective curriculum and 
metI\ods o^ preparing teachers, local and state adminis- 
trators and others to use data and information for 
decision making. 
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OATA NEEDS J SUPPLY OF SKILLED WORKERS 



, Jeffrey A. Windom 



One of the most difficult problems confronting vocational 
educeitors is the requirement that there, be a demonstrated labor 
market need for the students they train". The- problems of pro- 

. ducing valid projections of labor market demand have been 
demonstrated many times. Equally difficult — but less thoroughly 
exsunined— are the problems of producing reliable estimates of - 
labor market supply. That is, how many skilled workers are 
likely to be competing for the number of jobs expected to be 

-^available? 



This paper raises research -questions about some of the 
factors that influence the supply of skilled workers. The 
questions are organized into those related to occupational entry 
and those related to occupationa'l mobility and separation. The 
questions proposed are not intended to be exhaustive but illu- 
■ strative of feasible research with the potential for a good 
return on the funds invested. 

Occupational EntVy 

What are the employment objectives of training program 
enrollees ? When one attempts to estimate the supply of skilled 
manpower for a given occupation or set of occupations, there is 
a perennial problem associated with interpreting existing 
'enrollments or completioi\s. data. The problem is t;hat a sig- 
. nif icant but generally unknown proportion of program enrollees 
have already achieved entry into the target occupation of the 
program in which they are enrolled. In the short term, their 
goal is to improve their competency within their current occu- 
pation. In other cases, people who do not have employment 
objectives, enroll in occupational training programs for cultural 
or social reasons. As a consequence, it is generally unreal- 
istic to take enrollments or completions data as a direct measure 
• of potential supply to an occupation. 

This problem does'not haunt some data in which the linkage" 
between, the training program .and the occupation are fairly clear; 
examples would innclude adult vocational education, apprenticeship 
programs, and medical schools (e.g., M. D. programs). in other 
cases, however, the problem is generally recognized to be 
significant, particularly with data on universities and technical 
colleges. What is more, the problem will likely worsen as post- 
secondary institutions increasingly solicit adult enrollments in 
response to shifting demographic patterns. • ' 
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A partial solution would be to develop profiles of program 
enrollees. This would be only a partial solution, however, 
because student objectives do not always correspond with out- 
comes. However, these profiles, if used in conjunction with 
better follow-up data, would be useful. Since it would be 
burdensome to • include student employment objectives in insti-- 
tutional reporting requirements, a preferable approach may be' 
to conduct periodic. sample surveys of students so .that this 
important characteristic can be better described. 

What is the relationship between participation in occupational 
training programs^ and entry into occupations ? Although this 
question is not particularly difficult for vocational education, 
given current and proposed institutional reporting mechanisms, 
knowledge of the relationship is far less precise for other 
important training delivery institutions. This is notably so for 
universities and technical colleges. 

Follow-up data'^wr^rogram enrollees are necessary to deter- 
mine the flow of skilled manpower into occupations. In t^e absence 
of formal reporting requirements, data developed from voluntary 
follow-up surveys *are useful. For instance, many technical 
.colleges survey their graduates for institutional research * 
purposes and willingly share their findings. The problem ds 
that the data cannot be aggregated due to inconsTStencies in 
occupational classifications, program taxonomies, and other 
reasons 1 It would be useful to develop and implement a standard- 
ized follow-up procedures for two-year technical colleges, for 
example. A pilot project in a discrete geographic area, for 
instance a state, would be a good first step. A recent proposal 
to these institutions in Ohi,o for a uniform, centrally administ- 
ered follow-up study received nearly unanimous support. 

What contribution do occupational education program dropouts 
make to the supply of skilled manpower ? With current and 
proposed institutional reporting mechanisms for vocational edu-- 
cation, this question is not as important as it is for some other 
sources of skilled supply, particularly technical colleges and 
universities. For instance, most people who enter colleges and 
universities never graduate. But even though they constitute a 
majority, their rate and pattern of skill development is not 
accounted for in the higher education data base in a systematic way 

Traditionally, college dropouts have entered what are now 
the target occupations of vocational and technical education- 
It is not now knpwn whether the recent explosive growth of two- 
year technical colleges has created a flow of skills that is 
redundant or complementary to the traditional sources o)f supply 
for technician-level occupations 

/ 
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There is some evidence that' dropouts are having dif f icu-lty 
competing in* the labor market without credentials or, perhaps, 
without adequate skills. A recent Ohio State University »^study 
^found a substantial number of dropouts entering technical 
colleges or relat;ed programs, and a 1977 NCES study found nearly 
one-fourth of the enrollees in postsecondary proprietary schools 
were college dropouts. 

A useful piece of research, then, would be a carefully 
designed follow-up study of program i#n-completers , particularly 
those from four- and two-year programs, to specify 'the flow 
into occupations and to contribute to the articulation of the 
education system. 

What is the relationship between prevailing wages for 
occupations and labor force'^ participation ? The willingness of 
potential workers to enter an occupation is to a considerable 
but unknown extent a function of the prevailing wage rate 'for 
that occupation. A more precise specification of this relation- 
ship would be extremely useful in determining or estimating the 
supply of skilled manpower to occupations under various economic 
conditions. Put in simulation"" form, the trade*-off position of ' 
training additional workers or adjusting wages could be estab^ 
lished to asses optimal investment strategies. 

As an illustration of a possible approach t6 the question, • 
consider the following: Many areas of the* country are now 
claiming a "shortage" of nurses. Wages are known to show con- 
siderable geographic variatl<)n for this occupation. Since 
nursing is a licensed occupation, there is comparatively good 
potential supply data available [[.generally , a nurse need not be 
employed to remain registered) . Thus, using extant data, it may 
be possible for a researcher to describe empirically supply 
elasticity by measuring incremental changes in labor force 
participation while controlling for the size of the labor pool 
and employer requirements. ^ 

How have the increased educational, attainments Qf workers 
influenced occupational supply ? Por most of the twentieth 
century workers have progressively increased their average level 
of educational attainment for most sets of occupations. At the 
sama^ time job competencies and functions havQ also shifted to 
accommodate new technology and social preferences . 

There is a general lack of understanding of the way' tha,t 
educational -attainment relates to occupational qualif icatien 
and performance. The * theoretical base under lying ,i;hi^ .questign 
is inconclusive. For instance, some ecorfpmists feel tha^t the 
supply of skilled workers influences the size and structure of 
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employer requirements. , Other economists, notably Thurow^ hold 
that the structure of jobs in the economy is created first, and 
then employers enter the labor market in search of people to fill 
those jobs. If the latter is true, it is assured that employers 
will tend to hire workers with the best educa^tional credentials, 
irrespective of whether those credentials enhance job performance. 
Indeed, there is mounting evidence *hat many workers are over- 
educated and that this leads to boredome, job dissatisfaction, 
and a lower quality of working life. 

One of the major thrusts of affirmative action has been to - 
require that a relationship be demonstrated between educational 
attainments and job performance. Unfortunately, most of the 
investigation has been technically flawed. The economist's 
traditional measure of performance has been "wages," but that 
measure has something circuitous about it or begs the question. 

The recommended countermeasure is an investment ia additional 
research relating educational attainment to job performance and 
satisfaction. There is presently little literature on. studies 
using peer and supervisor review as the performance criteria, 
and additional work in the area could make a very important 
contribution in the determination of whether society's economic 
need for increasing educational attainments is real or imaginary. 
Th^ preferred methodology, of course, is case study at the firm 
level. It should be^ noted that there is likely to be a very 
favorable cost/potential benefit ratio associated with such 
research. 

. Occupational Mobility and Separation 

What is the relationship between employer-sponsored training 
and occupational mobility ? "It is known that American industry 
invests considerably resources to develop or improve the skills 
of workers in lower-through upp'er-level occupations. There are 
several important questions about l^is' activity for which little . 
information 'is currently available. 

V 

♦ 

The proportion of training that is remedial in nature is not 
known. That is, must employers supplement basic education of the 
secondary sch©ol system? The amount of training that is firm- 
specific, is now known. It would be useful to know the balance 
between training that is inclined toward .firm orientation or 
indoctrination and that which leads to a bona fide occupational 
competency transportable to other firms competing in the labor 
market. Also unknown is the balance between training provided 
for occupational entry (trainee or unregistered apprenticeship 
programs) and that provided for upgrading within or between 
occupations. Tt would also be useful to know the extent to which 
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firms contract with formal training institutions, the types of 
firms which are most inclined to provide training, and the 
occupations that receive the most attention. 

While a few studies about employer-sponsored training have 
been completed, they really only scratch the surface. The pre- 
ferred methodology for this type of research is establishment 
survey. fThe Bureau of Labor Statistics is currently involved 
in some related projects, but additional- investments .in care- 
fully designed efforts would prove very helpful. 

What are the career la'dders and lattices -associated with ' 
- different entry-level occupations ? When one attempts to measure 
and describe the supply of skilled manpower to most middle- and 
upper-level occupations, an important consideration is the flow 
of workers from lower- and.,entry-level occupations, which typi- 
cally are related in some wSy. For instance, it is generally 
recognized that most automotive repair supervisors were once 
automotive mechanics. Many of the latter, in turn, were once 

mechanic's helpers. A person who transfers from occupation "A" 
to occupation "B" must be counted not only as an entrant to "B" 
but as a separation from "A" as well. This flow can be de- 
scribed by using a set of transfer, or occupation mobility rates 
within the framework of a simple iijput/output matris^ or Markov 
chain. 

The most straightf orwa.rd method of developing these transfer 
rates would be to examine the occupational 4tatus of the same 
porkers at two or more points in time. Collection of such 
longitudinal data, however, is difficult and extremely expensive.^ 
The major existing longitudinal data bases ^ such as the National 
Longi'tudinal Surveys, do not have samples large enough to permit 
reliable estimates of transfer rate for discrete occupations. 
As a consequence, existing knowledge about career profiles is 
imprecise for most occupations! Better information would prove 
invaluable to occupational training program planners. Equally 
Important, the process of evaluating career opportillnities would 
be enhanced for the individual. 

The clear alternative to longitudinal data is to use cross- 
sectional ^data to seek enlightenment on this important question* 
The 5 percent sample in the 1970 Census includes a question on 
the respondent's "occupation five years ago," Some preliminary 
investigation of these data has been done by the Bureau of Labor 
Statistics. The Bureau observed that nfearly one-third of all 
workers who said they were employed in 1965 had changed occu- 
pations by 1970 • Further, mobility levels varied by occupation, 
with the lower-'level groups changing occupations much more fre- 
quently than the middle and upper-level groups. The principal 
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^imitation of the census data is that accurate estimates of net 
mobility (i.e., transfers in minus transfers out) for each occu- 
pation are difficult to develop. Nevertheless, some experts 
believe that additional information can be' developed from these 
Census data, particularly if used in conjunction with matched 
samples from theo Current Population Survey, 

Another approach to the> question would ba to survey members 
of a given occupation (s) , asking them to describe their career 
history.' The responses could be assembled- to develop career 
profiles and, if supplemented by findings from the Census data, 
would be very useful. The classic problem with this approach 
is the identification of a survey sample (i.e.,' where does one 
obtain a list of people who are, say, laboratory technicians?). 
It is recommended that potential studies, in the area of occu- 
pational mobility not be. overly ambitious, and instead focus 
on a limited number of occupations or occupational clusters. 
A well-designed pilot or demonstration preset would be of gf&at 
value* 

How does the pattern of separation from occupations affect 
the needed supply of skilled manpower ? An -important fact Often 
overlooked xs that total projected 30b openings due to ' 
^ separation (death, retirement, disability, etc*) outnumber 

those due to growth by roughly three to one. While considerable 
^attention has been paid to identifying growth obcupartions , there 
is. a serious problem in the estimation of occupational separation 
which also warrents attention. 

At present, xhe Bureau of Labor Statistics uses Current 
Population Survey data on ^labor force participation by age and 
sex to construct working life tables, which provide net labor 
force separation rates by age and sex for all workers. The 
Bureau applid#^ these rates to census employment data, by occu- 
pation, age, and sex, to yield net labor force separation rates 
by occupation. The principal shortcoming of this procedure is 
that it does not evaluate occupational characteristics, which 
surely have a strong bearing on labor force separation patterns. 
For example, physicians may tend to persist in their occupation 
because of professional commitment, while assembly line workers 
may retire early because of boredom, and structural workers may 
exit from the labor force because of their tendency to fall 
from beams. 

There is nothing conceptually mystifying about thi'k^ question 
yet a suitable methodolo'gy has yet to be developed. Existing dat 
could probably be utilized, and the potential payoff of a good 
effort is substantial. 




THS FEDERAL ROLE -IN IMPROVING EVALUATION 
STRATEGIES FOR VOCATIONAL EDUCATION 
John D. Skinkle and Katy Greenwood 



Recent studies and their respective reports (including those 
'Of the General Accounting Office, Ellisu, the National Association 
of Me^nufactu'rers, etc.) have docimiented the need for examining the 
barriers to, methodologies for, and utilization of various eval- 
. uation strategies within the 'field of vocational education. 
Because of the widespread problem nationally, U.S.O.E. should 
identity ways that national projects might assist the various 
States in responding to the need for more effective evaluation 
stra^tegies. The following comments and recommendations for fed- 
eral fo^i are organized according to themes, or concerns; 
(1) causes that have prevented the development of evaluation 
systems ; (2) methods that have not yielded the necessary informa- 
tion needed for optimal decision -making; and (3) expanded utiliza- 
tion of evaluation capabilities. Potential solutions in the. form . 
of federally funded projects follow the identified problems. . 

. - Cau seg T hat Have Prevented the 

t 

Development of Evaluation Systems W 

There is no hard evidence as to why the field of vocational 
education has fallen short in providing adequate evaluation strate^ 
gies. Causes can only be conjectured, and therefore possibilities 
for alleviation of the causes are only speculative. However, it 
is clear that the federal mandate to "evaluate'* had not been stimu- 
lus enough to provide adequate evaluation systems. 'The following 
problems ahd possible solutions are offered for consideration: 

t 

1. There has been inadequate orientation and formal prepara- 
tion for state and local administrators regarding the 
, ^ value, uses, and methodologies of evaluation. 

Members of respective state staffs have operated within ^ 
a strict compliance mode in terms of federal law. This 
meant that state personnel did not need to be skilled 
in planning and evaluation techniques. Consequently, 
there have been insufficient attempts to prepare state 
• staffs to thoroughly understand the theory and practice 
of evaluation even though state and local .governments 
had assumed major fiscal responsibility for the support 
of vocational education. 

• 7 
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Federal Role ; Therefore, \ it is suggested that a national 
project be designed and funded to provide personnel 
development for key, state \staff per'^sons at the^same 
time new evaluation systems\are being developedTvA few 
states could serve as deinons'|:ration sites for dif^rent 
evaluation techniques. Respective task forces coiiprised 
of state staff persons would ex^ine and try out iliffer- 
ent strategies in developing ahd operating various evalua- 
,tion systems . i 

Members of State Boards, for v4cational Education have not 
been properly oriented to the i^ays in which . evaluation 
activities might enhance policiy-developia^nt and decision- 
making. ^ . 

Federal Role ; A national project might be initiated 
wherein various media approaches coiald be u^ed in brief 
presentations, seminars, and/or v/orkshops to' familiarize 
key indi'^iduals with the purposes, value,, and utilization 
of evaluation activities and results. 

State legislatures have r\ot been sufficiently convinced 
of the need to provide funds specifically for the evalua- 
tion of educational endeavors. , 

Federal Role *- Utilizing an approach sdmil'cir- to that men- 
tioned above, attempts must made to familiaxize state 
legislators with the purposes, value, and use of evalua- . 
tion efforts in all education endeavors.). 

I^reteqUkisites to evaluation, such as the "development of 
gqals and purposes of vocational education at state levels 
have been ambiguous and unexamined. These must be care- 
fully reviev/ed, clarified, and legitimized in order for 
evaluation to be useful. 

Federal Role ; A national project should examine the pro- 
cess for establishing goals for vocational education 
within the various states'. Goals should be compared for 
diversity, comprehensiveness, and feasibility.. 

State-wide evaluations have been assumed to-be too costly. 
The assumption has been that ever y program must be evalu- 
^ated. Sampling techniques were not adequately explored; 
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^ Federal Role ; Through the uses of * case studies , sophisti-* 
cated sampling stijategies and/or pther techniques, pro-^ 
jects should examine the relative difference in approaC?hes 
to evaluation versus costs involved. 

No acceptable state-wide models have been developed for 
extensive use. There are some systems which only examine 
the secondary-level programs i others critique only the 
effects at the post-secondary level; ^till others review 
only certain program components. Some have dealt with 
process evaluation/ others with product evaluation. Some 
states have developed follow-up systei^s while others 
have peer review as a singlar evaluation emphasis. 

Federal Role ; Projepts should be funded Nto establish 
demonstration projects within key states in ordfer to 
ascertaiil feasible and effective ways for conducting and 
utilizing comprehensive^ state-wide evaluati9ns. 

TheiJe has been resistance from regional accrediting agen- 
cies, when various states have wanted to establish state - 
wide evaluations. 

Federal Role : A project should be undertaken that will 
examine the ways and means by which accreditation effects 
may be most effectively linked with state-wide evaluation 
efforts. ^ 

Key components, such as program standards, of state and 
local evaluation efforts have not been developed. 

Federal Role ; The government needs to assist program 
areas to develop .standards that can be used by states, 
accrediting agencies, and loqal schools to evaluate pro- 
grams . ^ 

The function and scope of various agencies mandated to- 
evaluate vocational education haye not been clearly 
delineated. ^ The state agencies, local schools, state 
advisory councils, the National Advisory Council, and 
others do not have a clear view of the role and bouhdaries 
of their function to evaluate # 

Federal Role ; It is suggested that a project be initiated 
to conceptualize the substantive issues of vocational 
education evaluation. What are the role, scope, and func- 
tion of such activities; what types of efforts should be 
undertake^ by various groups and agencies? 

Higher education institutions with graduate programs of 
vocational education have not given sufficient attention 
to strategies for evaluation, planning, and accountability. 
Practicujus and new courses should be developed. 
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Fedeijal Role ; Working through a council of teacher 
educator^, a state of the art paper focusing on evalua- 
tion and planning for ' vocational education -could be 
developed. Subsequent competencies, instructional 
techniques and appropriate materials ■ could be identified, 
developed and pilot-tested. _ 

Planning and evaluation components within vocational ^ 
education sections of state departments have not (suf-- 
ficiently) linked their efforts with the central plan- 
ning and evaluation unit at respective state agencies. 
(Perhaps more coordination would reap a more comprehen- 
sive, viable state-wide 'system. ) 

Federal Role : Comparative projects should be -initiated 
within state agencies to contrast an in^:egrated versus 
isolated approach to vocational education evaluation* 

There has been a lack of coordination between levels 
of vocational education which has prevented the establish- 
ment of viable evaluation systems. , Members of higher 
education coordinating boards, statB agencies, community 
college boards, adult education agencies, and manpower 
programs have not yet attempted" to cooperate extensively 
in the development of a comprehensive, coordinatedv 
evaluation system linked to all vocational education 
endeavors - 

> « 

Federal Role : Demonstration projects might he funded tq 
.coordinate various cooperative efforts to link evaluation 
sub-systems between various levels and types of. programs. 



Lack of Information Needed for Decisions 

Methodologies, strategies, and criteria used for making 
decisions based on evaluation efforts have often reflected 
archaic or unimaginative philosophies of vocational edu- 
cation. They have assumed placement on the 30b was suf- . 
ficient evidence of program success • 

Federal Role : The states should be assisted in identify- 
ing additional criteria for determining the success of 
vocational' programs . (Vocational education has too. few 
observable and measurable indicators of success.) 



Evaluation methods have generally focused on tjne process, 
of providing vocational education within a local education 
agency. They have not directed attention to the evalua- 
tion of other agencies (e.g. manpower) , effectiveness of ' 
state staff , etc. 
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Federal Role ; Evaluation activities which include more 
than the traditional peer-group_ review must be explored. 
Different combinations of various techniques should be 
tried 1::o determine effective and efficient schema for 
evaluating vocational education. 

« • * 

3. Thore has not been sufficient usS of periodic, third- 
party evaluations as an integral component of a com- 
prehensive -evaluation ^sy^tem to provide an objectivity 
riot otherwise available* 

Federal Role ; The federal government should consider 
funding demonstration projects which would attempt to 
build such Jlkfaluations into the total comprehensive 
evaluation" system. \ The final outcomes of these projects 
would be long-term )and short-term evaluations using a wide 
variety of techniques which would expectedly be incor- 
porated within the overall evaluation effort on a periodic 
(or continuous) basis. Such efforts will serve as a 
check-and-balance on the validity and objectivity of 
vocational education evaluations, 

. V- ■ . ■ / 

Expanded Utilization of Evaluation Capabilities ' 

Distinct evaluation activities versus the development of evaluation 
systems . . . 

* . ■ ■ - ■ 

In the past, evaluation efforts have' typically been distinct 
activities associated with discrete times. There have been defini- 
tive beginning and ending points for the evaluations conducted. 
,As a result, there have been two distinct consequences. First, 
most evaluations have been relatively shor|:-term in nature; and 
second, they have not been linked to the ' continuing administrative 
aspects of the education systems. It is difficult, or impossible, 
to hypothesize and subsequeAt^-y determine long-term effects of 
administrative and/or programmatic efforts .via short-term* evalua- 
tion. In addition, since evaluation is ,conducted to enhance and 
effect a rational, decision-making process, evaluation 'efforts must 
Be more than a composite of singular assessment activities. They 
must be integral elements of a comprehensive, structured and on- 
going evaluation system which will enhance the administration of 
the education system in both its policy direction and 4-ts opera- 
tional management. Also, evaluation systems must serve as the 
base from which to develop the rationale for and foci of vocationa 
education renewal. *. 

Therefore, one priority for the future funding of evaluation 
efforts might encompass the establishment 6f extensive, broad- 
based evaluation projects which would receive decremental alloca- 
tions for financing the development of evaluation systems which 
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will ultimately be self-supporting^ continuous^ and a base for 
future decision-making,. Such an effort would require that the 
federal goverilment assume the primary co^ for development of 
evaluation syst^s (during the initial ph^es of the projects) 
with the state government assuming the cost\of operating and 
utilizing the. system (during the latter phases of the project 
contract) . For instancy , decremental funding of developmental 
projects might involve 80% federal funding the first year^ 50% f 
funding the* second year, and 20% funding during the third year. 
The respective state (s) involVed would provide additional state 
funding of 20%^ 50%, and 80% for each of the respective years, 
with additional funding of 100% for two more years* Not only ^ 
would such a project rodnforce the concept of "seed money" advo- 
catecj by the federal government/* it would require the state(s) 
to make a. long-- term cortunitment to evaluation which wag specif id- 
eally linke^d to the total programmatic vocational education effect . 
within a state- Such an arrangement would increase the probability 
that evaluation would become an integral aspect of state and local 
administration which could ^ be continued indefinitely # with or with- 
out major modification of the evaluation strategies, methodologies ^ 
and techniques employed, ^valuation ..activities of this type . * 
could also ioe used in other states as demonstration projects r 
which could be^expanded, modified, and/or fused into existing 
evaluations systems wherever and whenever possible. 

Meta-evaluations. . ' V 

— — — — ■ - ■ • . 

It is not unreasonable to assume that substantial progress has 
been m^ide in the evaluation of vocational educatioiii however, 
there is considerable instruction still needed to identify the 
optimal ^oals, methodologies, and strategies of evaluation. Pre- 
sently, evaluation efforts are considered an important element 
within the educational enterprise. With considerable funding 
being made available for evaluation activities , it is expectied 
that valid and useful information will be made available for pur- 
poses of decision-making. 

Assuming that there have been some worthy evaluations con*- 
ducted in the past, it may be appropriate to examine 'these efforts 
via meta-^valuatiqns to determine strengths to possibly include 
in future' a^ctivities. It may also be useful to identify weaknesses 
which may be off-set in -the future. Basically, a meta-evalua'tion 
can be defined as an attempt, to describe an evaluation activity and 
judge it against a conceptualization of what constitutes good 
evaluation practice. 

Meta-evaliiations can be used to address some of the more sub- 
stantive issues associated with eva'luation. Among others, meta- 
evaluations can assist in the assessment of. the: 
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. a. merit, of previous evaluation efforts; 

b. extent tc5 which -e^luatioas have facilitated (1) decision- 
■ making, and (2) compliance with requirements of account- 
ability; and 

■ . _ ■ / ■ ' ■ . 

c. evaluation objectives, the appropriateness and implementa- 
tion of evaluation designs, and the worth -of evaluation - 
results. 

Meta-evaluations can also be used tb determine whether evaluatioit 
efforts are directly or indirectly linked to the impro\irements of /• 
operations such as policy development, administra*.ion^ instruc- 
tion, and research and development activities . Is evaluation 
b^ing utilized for more than just explanation? .Are evaluation 
activities being used for planning and decision-making? Evalua- 
tions of evaluation activities might contrast m^cro-verTsus macro- 
level evajluSitions but would probably not provide thfe syst^atic and 
aggregated d^ta base necessary for contemporary educational • 
leadership to make poJ.icy and planning decisions at -the state 

and/or national level. , - 

'*■ " * - ^ ■ 

Therefore/ pne priority for* future R & D funding might involve 
conducting second-order evaluations- of three different levels of 
previously conducted evaliiations : local, sta|;e , and federal , In » 
addition, it might be feasible in certain instances to suggest - . 
secondary analyses of data which had been previously collected on 
•major evaluation studies. Possibly the state of tl^e art in voca- 
tional education evaluation and the expanded utilization of multi- 
variate 'analysis techniques by professionals within 'the field have 
made it feasible tq address new issues and questions with j^re- 
viously collected data, 'it might also be ^ighly desirable to • / 
re-analyze data for the purpose of analyzing the original 
research, questionis posed for cong^ideration. 
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VOCATJONAL EDUCATION EVALUATION 
John A. Klit 



Introduction * ^ 

« 

The utilization of fonual evaluation procedures within 
vocational education is, at best, in its infancy. Since the 1976 
Amendments, evaluation has received more emphasis than in the 
years aftjer the 1963 Amendments. This has cati^ed much concern 
and Consternation among vocational educators. Our efforts can 
best be summarized by stating that we now recognize fche need to 
conduct evaluation activities. We can- understand the procedares 
by which such activities can occJur but we have yet 'to recc5gnize 
what to do with results of evaluations. This is evidenced by the 
jjum£>er of evaluations that result in nianeirous answers to questions 
that never' existed. We have not yet learned to utili'ze the .pro--x. 
duct from conducting evaluation in program improvement, account- 
ability or piiblic relations purposes. 

I have attempted to identify areas of needed research of 
developmental activity within the study of vocational education 
evaluation. The suggestions, have been organized around the three 
aYeas of: a) concepts of evaluation? b) procedures for conduct- 
-ting evaluations; and cj the use of evaluation results. I. have 
identified specif ip pr'oblems or concerns that exist within each 
of these categories and attempted^ to suggest needed rilsearch or 
developmental activities to overcome the problem or' concern. The 
specvfio problems or concerns by category includes 

A. Concep^ts of Evaluation 

1. Limited Foundation for Conducting Evaluation 

2. Cost Effectiveness of Various Evaluation' Techniques 

3. Conceptual Model for Evaluation 

B, Procedures for Conducting Evaluations 
1'. Locally Directed Evaluation 

2. Involvement of Lay Citizens in Evaluation 

3. /Assessment of Student Achievement 
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C. Use of Evaluation Results 



• 1. Integrating Evafluation Results 

2. Reporting Results 

3. Utilizing Evaluation Results for Public Relations 

I will now present a more detailed discussion of each of these 
areas. 

A. Concepts of Evaluation 

. * 1 . Problem or Concern; Limited Foundation for Conducting. 
. . Evaluation . Although the emphasis on evaluation is a ' 
recent concern to vocational educators, it has existed in 
other fields of study for many years. The theoretical 
^ foundation exists in these areas and should be drawn upon 
and applied to the evaluation of vocational programs . 
Instead of vocational evaluation meaning little more than 
follow-up studies on on-site visitations by tecims of 
"experts, ••■ we feel that evaluations must result in quanti- 
fiable data. ' ^ 

Suggested Research or Developmental Activities . Other 
fields of stu^y such as economics, .anthropology, law, 
journalism, r^edicine, and law enforcement have instituted 
"accepted" technologies of evaluation which would l}ave 
substantial applicability to vocational education. From 
such fields* could come improved methods of^ investigation, 
interpretation and reporting of results. We must then , 
overcome bur heavy reliance on quantifiable data which we 
have difficulty interpreting. Once various evaluation 
techniques had been gleaned from other disciplines, we 
would have to adapt and test them within vocational edu- 
cation. ^ 

2. ' Problem or Concern; Cost Effectiveness of Various Evalua - 
tion Techniques^ We have not been able to equate the 
value of conducting various evaluation methods to costs 
incur]?ed, both in terms of additional dollars expended 
and personnel time required. . " 

Suggested Research or peyel6pmental Activities . With 
fewer staff and financial resources available fbr voca- 
tional education programs, cost-effective ways must be 
developed for directors to select the most appropriate 
evaluation techniques and to incorporate those techniques 
into their progreuns. Developing such methods would allow 
vocational educators 'to document both the <3osts and the 
expected outcomes of various evaluative techniques. 

^ . 3-89 
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3. -Proble m or Concern: Conceptual Model for Evaluation . All 
top often various evaluative techniques are not incor- 
poyated into a total evaluation approach. In addition, 
the consolidation of evaluative information at various 
educational levels such as local education agencies, state 
education agencies and federal education agencies does 
not bccur. 

Suggested Research of Developmental Activities > With some 
reservatiorj, I suggest that: available evaluation tech^ 
niques be consolidated into a model, from which program 
personnel can easily ascertain the most effective evalua- 
tion prqcedure for their progrcun. The model must also 
include the most effective methods of consolidatir\g 
data and utilizing them at the local, state, and national 
levels. Such a model would permit vocational educators 
to develop evaluation systems that would provide them with 
sufficient data for decision making. 

By Procedures for Conducting -^Evaluations 

. 1. Problem or Concern: Locally directed Evaluation . The 
staff of most local education agencies are deficient in 
program 'evaluation techniques. They have neither the 
understanding nor the tools with which to complete evalua^ 
tions and utilize^^Jjhe results in program improvements. 

Suggested Research or Developmental Activities . A compre-- 
hensive set of materials should be developed to aid local 
agency personnel in conducting their own program evalua- 

* tions. This material should provide a rationale to staff 
for conducting a specific evaluation activity (such as 

' cost outcome analysis) , provide them with the suggested 
steps necessary to complete the activity, and provide them 
with suggested instruments to assist them in interpreting 
and. utilizir;g the resulting information. This set of 
materials should complement the comprehensive model deve- 
loped as a result of item A-3 above. 

2 . Problem or Concern: Involve ment of Lay Citizens in Evalua - 
tion , Related to the locally""^ re cted evaluation activity 
included in item B-1 is a concern for the involvement of 
non -educator s in the process of evaluation . Vocational 
educators have yet to harness the employment knowledge of 
the communities they serve. 

Suggested Research or Developmental Act^lvity . We have 
isolated cases of successful involvement of lay citizens 
in the evaluation of vocational programs. New study 
should draw upon successful procedures and result in a 
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handbook designed to proyi-de educators with the guides and 



a research activity isat instead a developmental activity 
which would have great utility in both pre-service and 
in-service education of vocational educators. 

4^ ' . i ■ ■ 

3 . Problem and Concern; / Assessment of Student Achievement . 
Vocational educai*ion evaluators are faced with a major 
problem when considering the mandate within P.L. 94-482 ^ 
to assess vocational student ac|jievement. Considering 
the state-of-art of vocational evaluation, the degrfee to 
which the mandate can .and will be met is questionable. 
My opinion is that it cannot be met if we expect to be 
able to aggregate data from student achievement roieasure- 
• ments either within states or across states by program area. 
Employment needs and curriculum content do and should 
v^ry from locale to locale. Standardization of curriculum 
content should not be forced through testing procediires. 

Suggested Research or peyelopmental Activity . Considerable 
work is needed to determine first the feasibility of the 
mandate assessing student achievement. Student achieve- 
ment testing "within other disciplines must be researched. 
The result should provide a desirable approach to mett ■ 
this need, within vocational education. This initial acti- 
* vity should be. followed by a major developmental activity 
to provide vocational educators the tools by which student 
achievement can be assessed, tools which must be tested 
across several- vocational progr aim areas. These evaluation 
methods would play a major role. when legislators determine 
the degree to which the mandates of the '76 Amendments 
were met; the project should also provide direction for , i 
the rewrit4 of the amendments that will occur prior to * 
1982. ■ , 

Use of Evaluation Results 

I . ■ . II . — I ^ V 

1. Problem or Concern: Integrating Eva^luation Results , In 
VQcational education evaluation we have not yet reached 
the" point where ve can analyze and utilize data coining 
. from several evaluation techniques at the same time. As 
an illustration, we may conduct a studentjfCollow-up study 
but are unable at the same time to tak^^account of student 
intererst 'and achievement data. Were we able to develop 
such a system, we might be able to run e^lfaluations more 
efficiently and economically. .As an example, certain 
evaluations, such as cost outcome analyses within local 
education agencies, might more feasibly be conducted in 
a different department each year. Other sorts of evalua- 
tion might more effectively be run periodically rather 
than annually. 
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Suggested Research or DevelopmeQtal Activity , The end 
product of this activity would be a handbook which would 
enable vocational planners to obtain 02,timun\ data for the 
decision-making process. For example, the data needs 
required by the Vocational Education Data System (VEDS) 
should become part of the total evaluation plan. Data 
from evaluation activities such as student and employer 
follbw-up should first be utilized to improve the 
program and secondly to complete the VEDS forms. vSuch 
considerations as the maturity of a program and its data 
needs must be built -^i^o "lihe resulting handbook. 

Problem or Concern; Reporting Results . Considerable 
energy is expended conducting various evaluations but the | 
results are never utilized in program decision-iftaking 
efforts, often because final decision'-makers do not 
know enough about vocational programs and .are simply 
unable to utilize the evaluative data provided. Vocational 
educators have difficulty reporting data in a useable form. 

Suggested Research or Developmental Activi^ . Extensive 
study of data reporting techniques utilizedr outside 
vocational education would be beneficial , t^ the field. 
Much could be learned from biisiness and indjllstry graphic 
formats for summsftizing yearend data, ^ii^ddition, the 
use of executive summaries would do much to improve the 
use of evaluative data. 

To ac^mplish this^ we need to develop a handbook for ; 
reporting data to decision-makers. This would be a 
hands'-on guide written for vocational educators^ filled 
with reporting techniques. 

Problem and Concern; Utilizing Evaluation Results for 
Public Rela>^ions . Currently evaluative data ar^ hot used 
for public relations purposes although vocational programs 
are urgently in need of data that tran be used for this 
purjjose. We can no longer assume that our publics -can 
readily see the value of vocational education^ and will 
continue to support it. 

Suggested Research or Developmental Activity . We have 
used evaluative dat§^ for program planning and for accounta- 
bility^ but we should also consider huch data as a public 
relations tool. Vocational' educators need a handbook that 
can aid them in using evaluative data in this way. This 
handbook would include 1i compilation of tested methods 
for presenting data for public relations. The type of 
data and the data format most interesting to the 'p^k^li^ 
must be researched ^ When completed, the handbook should 
enable vocational educators to formulate a public 
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public served by the various programs offered. 



SUMMARY 

It is questionable how many separate studies exist within the 
list of suggested^ research or developmental activities. . Many of 
the suggestions could be combined into one study, with separate 
handbooks resulting as aids for conducting various activities. 
As an example, the data utillzation^ould logically be one study, 
with specific h^n^dbooks developed tfi^"^demonstrate data use for > 
program planning, accountability and public relations. 

If I Were fco put a priority on research needs, I would say 
that our theoretical basis for conducting evaluation is in need 
of expansion. We are^oo quantifiably oriented at the present 
time. 'The problem with this attitude is that most <^feintif iable 
data ar^ meaningless. As mentioned above, the other area of 
extreme importance is how to use evaluation results. 

The concept of meta-evaluation must also be cons:^dered in 
whatever endeavors are undertaken. I did not include that as a 
specific problem or concern since it is a geheral concept that 
must be considered whenever, any evaluation procedi^-e is developed. 

In addition, I' feel that many of the suggested activities can 
have relatively fast turn^ound time; I do not see a lot of two 
or three year research studies. I don't feel we can afford to 
wait that long. 

In summary, I have identified the major areas of concern that 
I recognize with existing evaluation endeavors. Keep in mind that 
evaluation (other than student follow-up) is relatively new to. 
vocational educators. We must develop materials that can" be 
utilized by practicing vocational educators, as well as training 
programs for those entering the field. 
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IMPROVING VOCATIONAL EDUCATION PLANNING AT THE LOCAL LEVEL 



Allison L. Jackson 

The major planning needs I see at the local level involve 
methods of improving the coordination among the various agencies 
and advising groups responsible for providing vocational train- ' 
ing. In this paper I have attempted to outline what' J consider 
the major research needed to improve planning at the local level. 
First I present a list' of seven needs related to iipproved plan- 
ning and then I present in tiabular form eight specific research 
questions and suggest approabhes for addressing these questions. 

Needs in Local Planning . 

f 

1. There is a -need to .increase coordination . between local 

and county 'level advisory -councils to develop and 

expand local vocational training. There has been a 

general failure of sta.te, county and local advisory 

councils to coordinate needs Assessment and planning 

* activities to provide a comprehensive approach to the 

same constituencies. This failure has been recognized 

in the legislation and the Educational Amendments of 

11976, the new CETA and Adult Education Acts require 
better planning. 
- ' ' . 

2. There is a need to identify those diffusion tactics 

most favorable for the communication of validated local, 
vocational planning. A series of studies conducted by 
Huli and H6slLer (1973, 1974, 1975) indicate the need 
for additional research on staff perceptions of diffu- 
sion tactic^. There is an apparent failure to communi- 
cate and transport valid^trategies from one program 
to another. -{NIE, 1973^75) 
', ' ■ ■ 

'3. There is a need to provide strategies for regionaliza- 
"tion of vocational training services to , a number of 
constitviencies concerned with adult, postsecondary and 
experiental learning opportunities . Th6re is an expand- 
ing need to articulate different relationships among 
health, human .resources training, and traditional voca- 
tional institutions. In the past there has been kittle 
or no attempt to interrelate long-range master plans 
\%of LLA's, county units and institutions (e.g. community 
colleges) and state and federal training programs. 

4, There is a need to develop a uniform data collection and 
analysis system for local level planning. The establish 
ment of the National and State Occupational Information 
' -Coordinating Committees have caused thirty-four' states 
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to initiate individual student cards for tracking and 
data purposes. f— • • - - - 
nology properly. 



data purposes. This is clearly a failure to use tech- 



5. There i^s a need to coordinated career education and voca 
tional ^ducation planning at the local level. The new 
Career' incentive Act (PL 95-2 07) attempts to avoid the 
duplication of a data basq^ in its Requirements for * 
statewide planning for .cai\eer education. The inter- 
dependent nature of career'^nd vocational education 
must be communicated at theXlocal, level to remove the 
"them ".and "us" syndrome. \ ~ , 

6. There is 'a n^lPto supply industiry with a better analy- 
sis of l^bor supply and demand datk. This need has 
grown greater because administrator s^have not effective- 
ly utilized predictive and quantitative models for • 
estimations, " 

♦ 

7. There is a need to develop urban vocational adiiinistra- 
tive talent to' work for local, state, and fedeial 
linkages to address\ the training deficiencdes ih the 
cities. While many reports have been written on this 
need, the elements of sexism and racism that may in- 
fluence the deficiencies have not been addressee 



In Table I, I raise eight possible research questi^jns thai 
I think deserve highest priority in investigating the needs I 
have .listed above. For each of the questions I raise, I attempt 
to skfetch a research approach that could be directed to the 
question. 
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TABLB Is SU&SSSTU) SBSSARCB Q05STIOIS 



QOSSTXOti/SffiSEARCa PROBLEM 



ISSTRUMEIJTATION 



TARGET POPOIATION 



ADMIHISTRATIViL PROCEDURE 



1»» Each stat» has numerous 
manpower/vocational advisory 
groups operating for improving 
vocational training. 

Question: How to fostex 
coordination of local advisory 
councils with the nujnerous 
state and regional bodies 
directing their efforts at 
human resources development? 



2^. Staff percept^ion of the 
e'f f ectiveness of local voca- 
tional planning activities . is 
affected by district donographics. 
(The problem is how to measure 
and interpret staff perception 
of LEA advisory board planning 
activities, in the light of 
district deinogre.phics? A snb- 
problem is, do the demographics, 
affect perception of L-'ffective- 
ness of LEA advisory boards? 



Xml HEW, Manpower Programs, 
inquiry sheets (1976)« 

1.2 Data Cbllection sheets 
which indicate the following: 

Formal Council Cbaracter- 
istics ' 

Functions, goals, strucuire, 
representatives ^ 

Reported linkages to Other 
advisory councils in 
vocational education 

1.3 Survey of LEA Boards of 
Education "Performance * in 
Planning* (see local vocational 
education planning ' guide 
Ohio State- University, 1976). 

1.4 "Opportunities for link- 
age". Technical Assistance 
and Training Corp., 1977. 



2.1 Biographical Data Survey < 

2.2 District Demographic 
Profiles from the SUA. 

2*3 District Planning 
Activities Effectiveness 
Survey* 

2.4 A multi-staged strati^fiad 
cluster design (see National 
Science Foundation, Offiqe of 
Program Investigation , March, 
1978, National Survey Contract 
#C7619848) . 



3 \ . 

1«1 A probability sample of 
all local \vocational boards 
of education. 

1.2 A /random stratified sasDple 
of aiy local advisory board 
sseinbers in a ^tate. Sample: 
(For N.J. the sfiimple vould in- 
clude approximately 147 voca- 
tional board \of education 
mer.ibers and o^er 2,000 advisory 
board members I) 



2.1 Vocational'' central Staffs, 
principals, and shop teacl^ers. 



.1 A telephone 
technigi:e , para 
technique develo 
Steven Salamore , 
Institute of Pol 
University* 

2-1.4 Paper 
administration a 
wide vocational 
(2) through rog 
tional associati 
and (3) at local 



interv^iewing 
lleling the 
ped by Dr. 

Eaqleton 
itics, Rutger 



and pencil 
t (!) state- 
bOcjrrl Hieetings 
onal educa- 
ons (PXA's) 

beard n^eotiJlgs 



2.1 liisting the breakdown of 
the state by Primary Planning 
Units, it would be easy to 
classify vocational school 
districts by demographics and 
compare staff perceptions of 
effectiveness of LEA advisory 
board planning activities. 
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TABLB X: {continued} 



STIOK/RESEARCfi PROBLEM 



INSTRUM2NTATI0N 



TARGET POPUXATJON 



3 • ' What reclonal patterns in 
local vocational planning ; 
materials usage are ^viden»t? ' 

jfcobal level ^vocational) 
advisory ' ' . * 



4.< What ar^e the roles of the 
superinte^ents and local- voca*- 
tional board presidents in the 
application of validated planning' 
practices for local AVTS? 



5, What are the competencies 
needed by local advisory group 
members and non-vocational school 
administrators to plan in a 
coordinated ^ manner with local 
vocational adininistrators for 
the advancement of occupational 
programs? 



3.1 Using the Northeast 
Cunjicullim Network as an 
example, all SEA, REA, and I£A 
library, media, and planni^ 
supervisory staff could be 
surveyed as to material 
ef f ectivenesjB and use. 



4 . 1 \/ar tables Structure ,and 
Organization of USA (vocation- 
al structure) Type of Profes- 
sional Staff Organization 



4-2 An instrument can 6$ 
designed which incorporates 
the basic planning practices 
jaeeded to pursue a comprehen-^ 
sive planning process. (Using 
the "Generic Planning Model" 
as a guide. 



5.1 Adoiinistrators Petforr^noe 
Assessment foni designed by 
Dr. Robert Norton^., Ohio State 
University (Perf onnance Based 
Cp?ricula Prograni^^ 1976) . 



3.1' Professional staff 
responsible for tbe dissemina- 
tion of planning materials to 
LEA'S. 



4.1 Alx w>cational 

superintendents. 



^.1 Comprehensive school 
superintendents, board of 
education menJbers. 



ADMINISTRATIVE PROCEDURE 



3»1 Through the National 
Curriculuia Netwp;rk, a randoai 
sample of professional staff 
could be pulled to respond to 
several Elements of this 
question mainly: 

. materials useage 
" . cojaparison of materials 
requested 



application of strategies 



4,1 Through local associa- 
tions of superintendents 
administer instruments . 



See Or. Robert Norton's 
Performance Based Curricula 
Program, 1976. 
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TABLE Is ^(continaad) 



QOESTION/RESEARCH PRDBt£M 



IMSTOOWEKTATION 



TAI^ET POPULATION 



AOHIKISTRATIVE PROCEDURE 



I 



6. What are the Characteristics 
of vocational teachers who dis- 
play innovative behaviors in 
regard tO' local level planning? 



7. What are t'he skills needed 
by local lev^fel professional 
staff in vocat:ional education 
to produce an effective place- 
ment service? 



B, What are the training needs 
for parents and community 
nifcjnbers involved in vocational 
education? 



See >teasurejnent of the Giange Orientation of Vocational Teachers by Earl B. Russell, Ohio 
State University, December, 1972, pages 51 and 52, . ^ 

(Dr. Russell's research can lead to further problem analysis for vocational planning, 
at the local levelj — . , 



Identified in Norton Study, 



Identified in Norton Study. 



Student Planning Question^ 
naire (See Dr. Robert Nortofi's 
Stndent Placement Service 
Study, 1977, pages 17-20\ 
P.eview the entire packet for 
f Urthez iiiSLrunientutiwn, 



Contact USOE, Office of Conimunity Education for Instrumentation, Design of Study, and 
Adnjlnistrative Procedures • , . ' 
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NOTES '-ON TRANSITION -FROM SCHOOL TO WORK ' 
Ksrry F. Silberman 

Tiiese notes assume a reader familiarity with the three 
voliimes prepared by Paul Barton and Bryna Fraser U978) on |;he . 
topic, "transition of students from school to work," entitled 
Between Two Worlds ; Youth Transition from School to Work / a 
report organized in to 'six elemei^ts; Til developing a rese a r ch 
networking capability, (2) developing school-w^rk transition 
indicators, (3) knowledge integration and synthesis, (4) pro- 
gram evaluation, (5) program experimentation, and (6) survey 
research. Most of the ideas I can think of are contained therein 
and I will not repeat those ideas heyre. ? ^ 

A few years ago. Research for Better Schools, Inc. identi- 
fied four central issues in an attempt to focus oh. key research 
topics concerning the transition of youth to adulthood: (1) 
youth unemployment , (2) youth segregation, \ (3) declining family 
structure, and (4) youth sociopathy . 

Another research agenda was prepared by Steve Heyneman and 
William Damiels (1976) for the Assistant Secretary, for Planning 
and Evaluation, DHEW . They concluded two research themes deserved 
top priority attention: (1) youth rights and obligations, e.g. , 
right to learn and the Obligation to permit others that right", 
and right to family planning irrespective of family opinion; and 
(2) sense of community/ e.g. , how the notion of community works, . \ 
in families and large3C groups to preserve social cohesion. \ j 

• ■ ' ' ■■■■ ...V 

Lois.-.ellin Datta and Corinne Rieder have placed their high- 
est research priority in three areas : (1) studies of measurement, 
(2) studies of implementation , and (3) long-term follow-up. They 
feel these three emphases will offer the chance for three tradi- 
tions to come together : • (1) research concerned with socialization 
and a"Golescent development; (2) research concerned with, the 
teaching/learning process in the. home , the school, the community, 
and the workplace; and (3) research concerned with how struct- 
ural changes in schools and the workplace develop and evolve . 
See the -NIE Fourth Annual Report of the National Council on 
Educational Research for further details on research in this 
theme. , ' 
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The Interagency Panel for Research and Development on Adoles 
•cence has prepared a Fifth Annual Report published by Muriel V. 
•^erkeley (1978) of the Social Science Research Group a.t the Georg 
>iashington University. It, sunfnari^es the major research themes 
of the various federal agencies. The model she used examines 
specific program areas (work experience opportunities ^ youth 
participation opportunities, preventive health car^ opportunities 
etc.) by the extent to which they enlist family, community, and 
societal resources to enhance physical, cognitive, and socioemo- 
. tional development of different target populations. 

In a talk at the second Career Education National Forum, I 
identified four systemic issues that separated researchers on 
school-to-wprk transition problems: (1) whether the researcher 
focusedl more on technical skill learning or on personal and 
social development; (2) whether the researcher emphasized indivi 
dualism/or altruism regarding duty to society; (3) whether the 
researtmer leaned more toward Marxism or toward more orthodox 
free-market Chicago school of human capital theory; and (4) 
whether .the research is centralist, favoring national manpower 
planning and categorical controls or is- decentralist , favoring 
local control and block grants with a minimum of federal inter- 
vention. 

Clearly any number of taxonomies can be used to classify 
research questions. My latest thinking on the school-work tran- 
, sition problem features a dualistic analysis Which is siimmarized 
in a draft paper which I intend to publish. The intrinsic- 
extrinsic dichotomy is useful because it yields two separate 
research agendas : ' 

1. Research Agenda From an Extrinsic Perspective 

An extrinsic perspective of the transition problem leads 
to questions about the best ways to help people get and 
keep jobs. Evaluations of the extent to which various 
types of training programs place graduates in jobs for 
which they were trained grow out of this perspective. 
Investment in labor market data^collection and projections 
to determine what forms of training are needed also come 
from' an extrinsic perspective. The emphasis is on the 
accurate description of the job market dejnands . 

Determining the skill requirements of various occupational 
-Clusters assumes central importance in helping young peo- 
ple bridge the gap between school and work. Surveys of 
employers must be conducted to determine the origin of 
' skills among their employees. Training and certification 
pathways differ by occupation, industry, and by skill 
level. Pre-employment training may or may not be required. 

» 
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Some occupational clusters require very little pre-employ- 
ment training; most of the training occurs entirely on the 
job. The research on transition problems of such job mar- 
ket entrants may focus on evaluating alternative procedures 
for assisting them with job placement, e*g,, assessment, 
counseling, job search workshops, interview techniques, 
occupational guidance , jo^ information systems , etc . 

'Other occupational clusters require extensive, training off 
the job. The research on transition problems, of such job 

.market entrants may focus on evaluations of alternative 
training opportunities, e.g., public school, training cen- 
ter, proprietary school, equipment manuf actyrers . Some o^^ 
these approaches may be more cost effective than others • 
Th? results of such studies generally do not distinguish 
outcomes that are attributable to the program * s certifica- 
tion and placement capabilities from outcomes that can be 
ascribed to the added value (growth in human capital) of 
the training per se; that provides another research 
challenge . , 

'In the extrinsic perspective, one's research agenda places 
high priority on studying the structure of the labor mar- 
ket, especially those structural barriers that retard 
career deve^lopment of groups with special needs • Studies 
of union job protective requirements, as' in the case of ^ 
arbitrary escalation of credentials, or studies of discri- 
minatory practices in hiring, compensating, and promoting 
minority group members", women, or the young, are given 
high priority because we need to have more information 
about such problems before we can rectify them. 

Some research priorities can be discerned from topics 
where much^work is being done,^. For example, most of the 
educational upgrading in the labor force between 1950 and 
1970 is due to upgrading (credentialism) within occupations 
rather than due to technological changes in the occupa- 
tional structure that demand a higher skii^ level. 
Rodriguez, 1978-) . ' And most of the upgrading is at the 
level; of the high school diploma, thus placing pressure on 
greater rvw^ibers of young pepple to seek a college degree 
as 0 pa£a^?ort to a permanent place in the primary workforce. 
A high pr^ research area in the extrinsic view is the 

study of^^^^^ikbor market segmentation. Human capital theo- 
rist$ maintain that the structurally unemployed cannot be 
incorporated into the workforce because of insufficient 
education -- ^the barriers to be overcome are claimed to be 
the skill deficits of the workers rather than barriers ^ 
within the job market itself. Yet, recent research indi-- 
cates that differentials in earnings between the primary 
and secondary I'^ibor markets cannot be explained away 

f 
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entirely by differences in labor force composition, qual- 
ity, or woSrker characteristics. There exist significant 
■ variations in the structural characteristics of the two 
labor market sectors — in the way that worker character- 
istics are rewarded, and in the rules by which they oper- 
■ate (Beck, Koran, & Tolbfert, 1978). The implication of 
. this line jof research on school to work transition must, 
take into account the dual structure of industrial capi- 
talism; it must also abandon the assumption that one's 
extrinsic rewards in the workforce a^-e solely a function 
of level of education and training. 

Closely related to the above is research on present inno- 
vations in redesigning social systems in work organiza- 
tions to aid in the more appropriate design of those sys- 
tems. In many companies employees* 4re becoming involved in 
the design of their work system. Participation in such 
activities can be a desirable form of work experience for 
young people preparing to make the transition from school 
to work. In short, from an extrinsic pe^rspective , research 
on changes in^the workplace will help pO^licy makers and 
educational practitioners design transitional vocational 
education services more responsive to sooietal needs. See 
the 1978 "Conference Report on Youth Unemployment: Its 
^ Measurement and Meaning," published by Department of Labor 
Employment and Training Division, for research* in the 
extrinsic perspective. j 

Research Agenda from an Intrinsic Perspective " ' 

An intrinsic perspective of the transition problem leads ^ 
to questions about how to improve th^n5uality of present 
educational experiences rather than how to prepare for 
future jobs. The intrinsic purpose of education is not ' 
subordinated to long-range occupational goals but rather 
to }?elp young people .find pleasure in the education pro- 
cess^ itself. Three ge'neral questions that emerge from an 
intrinsic perspective are: (1) what are the most effec- 
tive learning experiences for helping the young to achieve 
, adulthood?, (2) who should serve as role models i'n help- 
ing the young become apults?, and (3) what are the most 
effective ways of articulating learning experiences in 
•pT^mmunity organizations with campus academic programs to 
enhance personal development of youth? 

In "The Relationship of Education and Work," (1978) I 
describe a set of treatment variables derived from social 
learning theory which are hypothesized as contributing to 
the intrinsic value of an educational experience. 
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Pot example^ if students are exposed to a variety of work* 
experiences with the properties (quality ro^e models, rich 
network of communication, opportunities for self -regualtion, 
realistic consequences, etc*) described in the article, it 
is hypothesized that they wili enjoy greater personal 
growth than would be the case with work experiences that 
do not contain those element^. This^ is easier said 'than 
done; a full-blown program of research and development is 
needed to test this hypothesis , In order to test the hy- 
pothesis we must first develop valid instruments to mea- 
sure these treatments to insure that they are implemented 
as planned. There has been a failure to measure the treat-- 
ment in most reports on school--to-work transition programs. 
Variations in fied site experiences increase the likeli- ^ 
hood that different studies are not coir^'paring the same 
treatments even when they bear the samej label. There have 
beei] virtually no studies that tease apjart the treatment 
components and try to specify the crucijal variables that 
make the experience more or less effectjive. .This 'defici- 
ency makes replication of a stuc^y imposjsible. Th^efore 
a major step in the seqtience of research activity is to 
develop valid measures of implementation. Such measures 
sho'iild be compared 'with independent criteria to establish 
their validity and should be developed 1 from the same 
theoretical model that was used to speci|fy the treatment. 
These measures should also be used as a Manipulation check 
to insure that the actual treatment interventions that 
have been implemented coincide with the intended theoret- 
ical model . 

A second class of instruments must also be developed to 
measure the intended learning outcomes. If the transition 
problem is viewed from an intrinsic perspective, such ; 
outcomes are related to the personal development of the i 
student (e.g., locus of controL,. self-esteem^ conununication 
skills)' rather than job placement, income, or other intriin^ 
sic outcomes. Unfortunately, there are no completely adie- 
quate measures of such outcomes. It is not sufficient to 
depend 6n existing paper-pencil self-report instruments ; 
for our njeasures of maturation^l outcomes. The validity 
of these measures is sadly lacking, and much research atid 
development work is needed, 

A third class of instruments which must be developed in 
the exploration of intrinsic outcomes is. a set which 
i^easures student attributes that may moderate the iijf luence 
of the treatments . Frequently rcscalrchers measure only 
one characteristic, e.g., age or sex, 'and ignore other 
attributes, e.g., personality, cognitive style, attitudes, 
which may interact with the treatment. 



A fourth class of instruments which needs to be developed 
_are those which measure the^.organizational and ecological 
characteristics. of the larger environment that may moder- 
ate the influence of the treatments. For example, within 
organizations where students ar6 participating in work 
^ experience programs such dimensions as peer cohesion, free- 
dom of expression, competitiveness, staffing ratios, 
sal&ry levels, composition of group membership, orderliness, 
and role clarity can have as much effect on personal growth 
outcomes as the impact of the ititended treatment itself. 

• 

When adequate measures of these four classe.s of variables 
have been developed, the research program wpuld attempt to 
test clearly defined hypotheses concerning the relation- 
ships among these variables. Such experiments would be 
•conducted with adequate samples under conditions in which 
potent treatments would be tried over a long enough period 
for unambiguous results to emerge. 

The significance of such a research program is that we 
would obtain a 'better understanding of how effectively we 
are facilitating the transition of youth. We can deter- 
mine whether vocational education and. employment and 
training programs which are theoretically effective actu- 
ally produce more effective functioning and personal 
development in youth than programs without such features. 
Such knowledge w^uld have distinct implications for future 
legislation on vocational education and employment and 
t^raining programs. , . ^ 
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WORKING NOTES FOR RESEARCH IN CONNECTiON V71TH 
TRANSITION PROM' SCHOOL TO WORK 

Richard A. Graham 

Transition from school to work is part of growing up, coming 
of age, or joining society. The transition is of particular con- 
cern to vocational . education, but it highlights broader problems 
in American education. The 'problems can be put into three broad, 
categories, from which research questions can be drawn and ire- 
search projects. can be developed. These categories are: 

^ problems of equity in education,^ of rich and poor, and of 
setting intermediate goals for achieving it. , 

- problems of theor^^ and, stemming from these, proi?leins of 
effective program design. 

- problems implementation, of general persuasion artd 
organization -of resources , linkages , and procedures \ 
necjBSsa^y tq carry out the programs.^ 

I. Problems of Intenmediate G6als in Achieving Equity 

Neither the President's Domestic Policy staff nor the Con- 
gressional committees explicitly state the amount of educational 
improvement they seek, over a discreet period of time, f rom ^he 
array of education, training, and employmemt programs they* advo- ' 
cate or enacts The Domestic Policy staff and the .Congress have 
specified reasonably precise goals for increasing the employment 
of youth but economic and demographic vagaries make it di*^ficult 
to determine whether education and training programs have -played 
their part in improving the transition from school to work. A 
way of measuring the aggregate success of U.S. education and 
training programs ife needed, a measure that would complement em- 
ployment statistics in assessing overall effectiveness! 

^ The national problem is not so much . to improve transition 
from school to work in general (as indicated in Fi^. 1), bu^*to 
greatly imp^rove transition from school to work for poor minority 
youth and to improve the transition more modestly for others. 
(Shown in, Pig. 2). The difficulty here is stating the desired 
progress in terms that can be measured. It is, moreover, a 
problem of giving approximate weighting to'' several factors, that 
together constitute a measure that might be called "Transitability 
of American teenagers. it's not a measure of educatioTi, it says 
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DISTRIBUTION OF TRANSITABILITV TfRANSITION FROM SCHOOL TO WORK 
ABILITY) OF U.S. 18 YEAR OLDS 




1978 MEAN 1988 IMPLIED iSOAL 



FIGURE 2. 
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ittle abo^ "^culture or creativity , but it ^probably is a useful 
concept for assessing the ability of a teenager to get a job 'or 
choose further er^ucation. For whatever reasons, the trarisitabi- 
lity ,of disadvantaged youth. as «6ompared to middle-class youth has 
gotten worse in 'the past 15 years. Transitability includes the 
basic reading and writing skills vbcational skills,, coping skills^ 
^nd standing. Standing is related to measures of maturity, j^dg-- 
ment, and ^stability/ things that so far have proved hard to 
measure, but which are generally necessary to a successful tran- 
sitiGin. TJhey will be more fully ^ejKpl^ained later, 

( ' " ■ ' ' r , . .■ ■ • 

The Problem of Equity ' " ' ^ ' ^ 

* \ . * 

The ^ight of disadvantaged youths, compared with the^ dif- 
ficulties of youths from middle-income families, -^as judged by 
employment and labor force participation, has greatly worsened 
over the past 15 years, in.spitq of the mafiy federal programs of 
education^ training and employment , and'Civil Rights legislation. 
Overall, the differences in years of schooling between white 
youth and black youth have^ almost disappeared,- but th^^'dif ^rences 
in educational accomplishment remain practically the same with 
the poor minorities .lagging by almost as much a^ they did 15 , 
years ago. Although the diieparities in employment have continued - * 
to worsen year by year, there are some reasons ^ to believe that 
they may nqQionger da so* The back-to-basics . emphasis in educa- 
tion and efforts comparable to those of Rev. Jesse' Jackson ' s PUSH 
may have already begun tp reverse the trend, but a^ yet there is 
no evidence to support this assumption. Nor, indeeid, is there / 
conclusive evidence as to the origins of -the problem. 

The question is, therefore: Why the apparent failure of the 
laws and programs that were designed. to make growing up in^ America 
more nearly equal for the disadvantaged and the- middle-class? 
What reason is there to believe that the recent emphasis on 
career education, work experience and youth employment will im-^ 
prove matters? What, if any, changes sh^ould be made, in voc^tionaT 
education to complement these efforts? 

The evidence so far; There is no clear explanation as to < 
why minority youth have failed to improve their academic aChieve.- 
ment and employment in proportion to their increased years in 
schooling, but there are considerable data that could provide^ 
an explanation and^lead to a sb^^tion. These include the follow- 
ing^ research^ concl*6sions that need confirmation, in particular 
confirmation "that the things mentioned below have worse'ned for" 
poor minority youth: 



- economic achievement appears to %e more ^'strongly related ^ / ♦ 



* « 
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to an "attachment" to a school than to the number of years 
of schooliTig coitipleted. Minority urban youth from poor 
families tend to go -to large high schoolH where school 
attachments appear to be more difficult to* make. 

Students with ^ number of arrests had fev/er additional 
arrests if they dropped out of school^ than if they 
remained. Poor minority urban youth often belong to 
groups that are at least partly adversaria'l to mainstream - 
society and^ ;.if this is true, there, is less reason for 
them to take the action necessary to join that society, 
that is, to'prepare for a^job, seek it, and keep it* 

programs designed to i/ncrease a student ' s self -^confidence 
•and esteem^sometimes increase these qualities for reasons 
unlikely .to lead to further education or to steady employment 
Some programs designed to increase ethnic prido seem to 
have don.e/*SQ, but. at the expense of seeing "the establish- 
ment" (and its employers) as the other side. ♦ 

keeping a job depends more on the ability to get along 
with'si^supervisors and fellow employees than on job skill's. - 
•Youths, in particular, tend to get along better wit^ thos« 
who are similar to themselves and there tend to be fewer 
minorities in positions of authority, . " * 

" ^ \ \ ' ^ 

a -higher percentage of minority youth, as compared to • " . * 
white 'majority youth,, were in' the labor force., (employed 
or looking for work) -15 years ago, A higher percentage of 
^minority youth may now think that* looking for* work is not 
worth ^he effort. ' ., ' 

* < • ' 

maturity as measured by^ hpw .one , depides what to do, ia 
more a matter of- being atde to put oneself in another's 
shoes than it is of one's knowledge or -the quality of 
. counse;Ling one recQiives. Job status, and income seem to 
depend significantly on the, level cf vocational .maturity, and 
poor, youth, appear to receive an- education that is less 
likely to develop sj_icii.,-niatur ity . , . . • ■ _ 

'^'unexplained factory sopietimes referred to as luck and 
chance-'-, have more to §o with what kind of -work one 

^ does' than does IQ or' lc^vcl of education. Minority youth 

"'tend -to ha^ie fewer opportunities for the kind of luqk 
and chance ^hat, Changes lives for the bettor. (See later 

. • discussion . ) . ' ■ > ^ 

' ■ * * 

-.Most teenagers make decisions ba,sed upon_ what their 
' ff-iends think and do, rather than upon 6arecr goals or 
J the adviipc they receive from adults. Disadv-antaged youth, 

. ■ ■ ■ / . • . ' ' 

- f ' ■ - 3 -" -l i 2 . * ' ' 



asi: conipared to middle-cLass youth, ptobably place greater 
emphasis on group attachments and hence are more reluctant 
to seek work out of their neighborhoods. This, coupled 
with. the fact that ^.higher percentage of new jobs has 
been created in suburban areas in recent years, makes job 
hunti^igc tougher for minority youth. 

. Inhere are several differences in the way poor minority 
youth look for and land jobs and generally this works to 
the disadvantage of the poor minorities.* 

• - Poor minority youths tend to have lower standing with 

potential employers than do white youth and, though there 

. are reasons for some of this (minority youth, on the 
average, score lower on tests of basic sftills) , much of 
it is based on unwarranted racial prejudice'- e.g., 
"Black kids are not as interested in work as white kid^". 
The problem is that academic credentials generally count, 
for less than personal references or work history ,?and . 
these latter. are harder to come by for minority youth. 
Employers say that a diploma or certification of comple- 
tion of vocational training tells little about^ how wpll a 
person will do on a job: ' "\ ' ♦ . 



* Hacial Difference in Private Sector Job Search and Employment - 
Black teenagers tend to seek jobs in different ways than" whites 
-^they tend to use employment "services and ads to greater degree 
but use personal and family cpnnections to a lesser deg^ee^ be^ 
cause they tend less often to have; such connections. Small 
employers tend to use personal contacts for reaching potential 
emplc^ees to a greater degree than do larger employers. The ^ 
katqe employer tends to give more weight to credentials, .to 
work and' personal histories, arrest records and the like. The 
small employer, though often paying lower wages, generally * will" 
hire younger employees and will provide greater opportunity for 
learning on the job along with a more' personal relationship 'Be- 
tween supervisor and -employee. The larger employer g*enerally 

. pays minimum wage or above and tends to employ older ycmth and 
adults. - . r ^ 

The black teenager tends therefore to be at a disadvantage not 
only in getting a job but also in .getting a job. with the kind 
of personal relationships that often go with learning both 
occupational skills and the harder^to^def ine qualities of self^ 
assurance, and pr4ctical ambitioti which improve one's chances \ 
of getting ahead. 



Implications for Research on Problems of Intermediate Goals 
for Equity 

Although there are in the above observations Several hints 
^ at the reasons for growing inequity in thfe transition from school' 
o to work for the poor minorities, a clearer explanation is needed/ , 
The following research is recommended: 

1, An analysis that compares the findings of the major 
cross-sectional and longitudinal studies of youth , their 
opinions, education, employment, e.g, , Youth in Transition, 
Project Talent, Coleman, "Parnes ' National Longitudinal 
Study, Department of Labor Continuous Longitudinal Study, 
Class- of '72, Cla^s of '78, etc. ) from which cause and 
effect rielationships can be established , between attitudes 
(including generational norms) and experiences in emplby- 

^ ' ment and other subsequent life outcomes. 

2, Reexamination of the importance o^f, group norms on the 

^ adoption of individual conventions and the importance of 
; group heterogeneity on the advance of a participant's 
pattern of judgment, 

3, Conduct of a ""value added" research project comparable 
\ to the Harvard-based project for post-secondary educa- 
tional institutions. - " ^ . , 

4, The addition of cognitive developmental measurements 
(ego developmi^nt , social perspective, etc) to 'the long-- 
itudina'l st<fdies ref-erred to in Item 1 above. 




Extgj«?Ton to\ vocational education pro^grams of ^he project 
on the outcomes o^ experiential learning nowyfeeing con- 
ducted by the Center for Youth Development apd Research 
at the University of Minnesota on behalf of xhe National 
Association of Secondary School Principals, the Nat^opal 
Catholic Association, and the Lndependent Schools ^Associ^ 
ation^ In connection with this, additions to their de- 
sign might (1) include the use of instruments to measure 
the cognitive development as suggested above, (2) the use 
of the inventory devel9ped by Frieberg of the Educational 
Testing Service and (3) the Measure of Psycho-Social 
Maturity developed by Ellen Greenberger and others at the 
Johns Hopkins University - 
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II. Problems of Theory and of Program 

. V National efforts to achieve equity have no coherence in 
theory and hence less coherence than they could in practice. 
VJhile a working ccommodatiop between conf liotinq theories of 
human development is all that can be expected for the foreseeable 
future, the net effect of federally assisted projects could be 
increased by provisional agreement by program designers on the 
relative importand>aLof the things that affect the transition to 
work, A path model r»-^a graphic representation^^of interrelated 
causes and effects in one's progress toward life's goals. 
Figure 3 shows a typical path model based on data for non-farm 
white males, as presented in^ INEQUALITY : A Reassessment of the 
Effects of Family and Schooling in America by Christof er . J^cks 
and seven others. It is the model which they say "represents 
our best effort at describing the detern^inants of adult success 
in America". Data forewomen and minor^ities would produce a 
somewhat different path model but the same general conclusion 
could be drawn: schooling h^ less effect than, is generally 
assumed; luck^ chance, or urre^scplained factors have greater effect. 

Reducing the Effects of Luck and Chance: Contriving Fortuitous 
Events - 
« 

The implications for research on "transitioi? from schopl to^ 
workJ^*. aire j these. Research is needed to deteipwtlTe: 

a. in what ways opportunities for the /fortuitous differ 
between rich and poor, majority and minority • 

„. . b. the approximate effect of these differences. 

C. in which ways greater opportunities for the fortuitous 
can be contrived in programs of transition from ^chool 
to work. ^ , >^ . ^ 

d. the antilripated effect of increasing these opportunities. 

e. what other unexplained but significant yariables are' 
lumped ^with luck and chance but which migftt instead 
appear as program^ components in the path model. For 
example, "educational attainment" might be seen as 
having two compc^ents, institutional and experiential, 
With the latter so designed as to contrive experiences 
that are now largely left to chance. Without this 
'contrivence , the well-to-do are certhin to 'have greater 
opportunity for the fortuitous event than the poor. 
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FIGURE 3. JENCKS PATH MODEL 

TIME (OR LUCK) & CHANCE \ > ^ 
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\ To contrive the fortuitous ;Lnvolves more certain 

opportunity through experiential programs for; 

- taking novel responsibility^ 

• - finding a mentor or inspirational friend 'or 
helpful spouse 

- seeing new perspectives: career, faith, purpose, 
duty ^ 

- acquiring standing (skill, ability, distinction, 
or notability) 

- developing a new interest 

- being accepted by a congenial group 

- establishing a network of friends in power or 
position* 

Figure 4 below shows some of the common personal and 
program measures of experiential learning* They are: 

jt 

- Personal Outcome Measures 

basic skills 
occupational skills 

coping skills (maturity, psycho/social) 
judgment ^ 

' .career decision making (self--directed search, 

vocational aptitude tests, job knowledge, etc.) 

self-- image (self-es'teem/conf idence) 

work attitudes (work-related attitude inventory, 
job holding skills tests, etc) 

job-seeking ability (skills test) 

other fortuitous assets 



^ . ^ J. 

* To achieve the above, there is need for a Practitioner's 



Guidebook for Contriving the Fortuitoi^s, 
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FIGURE 4. ALTERNATIVE PATH MODELS 



TIME (OR LUCK) AND CHANCE 




PERSONAL OUTCOME MEASURES 



• BASIC SKILLS , • 

• OCCUPATIONAL SKILLS 

• COPING SKILLS 

MATURITY ' V 

• JUDGEMENT • 

• OTHER FORTUITOUS ASSETS 

• X)B SEEKING ABILITY-SKILLS TEST * 



CAREER DECISION MAKING 

SELF DIRECTED SEARCH 

VOCATIONAL ATTITUDE TEST 

JOB KNOWLEDGE 
SELF IMAGE 

SELF ESTEEM/COA^FIDENCE ^ 
WORK ATTltUOES 

WORK RELATE© AtTITgDE INVENTORY 

JOB HOtpJNG SKlj. LATEST 



- Program Outcome Measures 



credential or placement 
standing** 

retention (how, etc.) 



Measures of% Program E^ect on the Fortuitous . There is some 
overlap between personal and program outcomes and the research 
recommended here could apply to either. It involves developing 
measures of experiential programs in terms of the degree to which 
they provide opportunity for taking novel responsiblity and for 
experiencing the other, six fortuitous items in the list above. 

■ Measure of Program .Effects on Standing . A measure of stand- 
ing is needed as a program outcome. Employability is only one 
component of "transitability " and employability is for the most 
part determined .by standing, a complex mix of skills, academic 
credentials; work history, and personal contacts. . Most education 
and training prog'rams are designed to develop skills and confer 
credentia^-s rather than provide standing. Programs such as the 
Executive Internships provide standing that is derived from the 
recommendation of a person in power or ^Sosition and the network 
of contacts that generally come with close association with such 
a person. If standing can be better defined, it can mo^-e easily, 
be piade a program goal and the program outcomes can be better • 
assessed. 

Generational Effects . The path model shown in Fig. 4' and < 
the implicit path model in the minds of educational program 
designers and administrators generally neglect generational ef- 
fects. Although the generation in. which one grows up has profound 
effect On one's attitudes and actions in the transition years, 
(see studies by S-chaie, and th*e references in his bibliography) 
it is generally assumed that these effects are governed by luck 
and chance. Whether one gr£)ws ' up in a ' depression or a boom, with 
the Little Engine 'that -QQuld or Jonathan Livingston Seagull , with 
a drug or straight generation, whether in an altruistic or 'mater^ 
ialistic generation, is mostly a matter of chance. Although there 
may be some kind of cyclic swing in attitudes towards work, not 



A person has standing if he or she is an all-American , has 
worked for a good president, mayor; legislator, business or 
Civil Rights leader; has published or' performed or exhibited 
in certain places; if one's name is Ro'ckef eiler ; has made 
Law Review at Harvard; etc. % 



much is known about it. There is, therefore, a need for 
.research in : ^ 

- whether .th^re^ are cycles of youth attitudes towards work 
and the effects of these cycles on the life outcomes of 
youth. I 

- whether the pervasiveness' and duration of these cyclic 
attitudes can be predicted by general sampling of- youth . 

^attitudes or^ a regular basis. 

- whether there is an identifiable* forerunner group whose 
attitudes can be sampled in ways that will predict the 

. pervasiveness and 'duration of these generational effects. 

f 

- whether there are other sub-groUps whose attitudes Lag 
or are countercyclical. ' . „ 

- whether, given the ability tp predict pervasiveness and 
duration of a cycle, it is possible' and desirable to 
ameliorat^e its effects. Greater ability to- predict . 
affects - and publicize them - might trigger action ^greed 

, upon in advance, much like those efforts to dampen swings 
/ in the economy. " , ' - 



/ 

, / 



/ Problems of Theory as They Af^ecf Program Design . It cogni- 
tive developmental theory is correct, many transition to work 
^^programs are incorrect in their assumption that adolescents pos-^ 
sess the same structure of reasoning as most adults. Th^se pro- 
grams assume that since the necessary information for career 
choices is lacking, if it is supplied, adolescents will react as 
rational adults. Adults close to adolescentfs know that this is Sf 
not so, that most adolescents are guided to' greater degree by 
what their friends do and think th^n-by a .Cajfeer plah._ Adults 
may 'think that this is for want of career information , "but devel- 
opmental theory - and a great deal of evidence - holds otherwise: 
adolescents tend to. think in qualitatively different ways,' that • 
career planning - and hence much of tr-ansition - can be achieved 
more effectively by a combination of: 

- peer 'p^^ssure; by changing the norms or conventions 
of the peer group 

- change or diversity" of the "group" or "groups" to which 
one belongs, e.g^, to a new wpirk group, to a mentor and 
his or her associates, to a new team, performing group, 
etc. 
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- change in the individual's b^sic reasoning, as in Piaget's 
change offstage, or a change in the related . stages of egq 
development, social perspective, or judgments of what one 
ought to do. Only in the past few years have th&re been 
conscious efforts to bring "about changes in the stages of 
reasoning, ahd although there have b^en some promising 
results, these studies require confirmation. 

The mismatch -of adult processes of -reasoning and those of adoles- * 
cents becomeg evident in many programs of counseling. Additional 
research is needed to explain this phenomenon and its effect and tq 
make it understandable to ' counselors , 'teachers and program admin- . 
istrators.'_ - . , ' , ' . .' 

Theory and Practices The Fit Between Them * 

There is a need to test igransition program designs against 
both the generally accepted theory of human deVelopment\and the . 
practice^ that have proVed successfill. A checklist of- these i^ 
needed and* would not be hard to come by. Strangely enough^, there 
has been little effort to test program designs from both p^r^eC^ 
tives concurrently and there 'is considerable evidence that the ' 
programs have suffered fo^ it, ^ - 

Problems of Implementation; Providing Growing-up Job6 for Youth 
and Other Problems ' * ^ ^ . ^^""^ 

^ ^ : ^ 

ImplementatiDn. ^problems involve finding mor^ effective ways : ' 
to link educ^t^ion with the training and employment resources that 
serve adolescents. There is the problem of f ii^ding , agree^aent on 
goals, and the problem of channeling federal funds so as to in- 
duce collaboration in Valid and feasible transition to work pro- 
grams. High among current problems is the need to reallocate the 
existing resources, and to make a case for additional resources, 
so as to pifovide enough growing^up jobs for every adolescent to 
have a job that fits his or her needs* Qefore this can be done/ 
though, research is needed to develop: ' ' * 

1, An approximation of the aggregate national need for 
* youth jobs. This could be approached by determining in" 

,a high school of 1,000 students the average number of 
s 'each of the following sorts of jobs: 

- parttimc; casual .employment/ unsubsidized joiis (yard 
work, baby ' si tting , cleanup, etc,} ' . * . 
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- sacnal service, volunteer, ..nonpaid jobs (tutoring, 
i^lping the aged, handicapped, etc. ) , 

-pocial service, at least partially subsidized by 
J CETA or equivalent (working^ fo:; United Wgy or a 
municipal agency) " • 

r/- school or community organization' sheltered," income 
producing, partially subsidised jobs (running a 
school cafeteria or a sub, shop, running reproduction 
services^ or a printing shop, running a youth employ- 
i ^ ment 'agency , ' running a. school-based loan , a'gency. or 
i ' enterprise ban^c for students in the same fashion as 
i a small business investment corporation 

^ i - private sector, unpaid ^ork experience "jobs 
(e.g. ^ expe^-ien^ce-basecf career 'education) 

- private sector, at least partially subsidized jobs,- 
some with emphasis on wo'rk experience, some on 

'.parttime eraploym^^it (The VEPS program of the National 
Alliance of Businessmen or equivalent. The JOBS pro- 
gram, ' on7the7 job training, etc.) 

- private sector / uhsubsidized jobs. - 

The number 6f each of these_ jobs should increase as a, result of 
federally supported programs under CETA, vocational education, 
career educatioh and the like. Of the kinds of jobs' "listed above 
least is known about school sheltered, incojne prp'd.ucing jobs. 
This category may' of ^er .the greatest opportunity to increase the 
number of youth jobs and to "do so through programs that best meet 
the test of theory and successful practice in transition to wprk. 

2 . ' Approximation of the aggregate local, state and. federal 

costs of providing the needed jobs in all of -the; abpve 

categories . ' ■ , 

t * 

3. Approximation of the cost to. crifeate a job in each of / 
several categories about which little is known, specifi- 
cally the cost of <:reatirtg a school sheltered income-' 
producing job as compared with the cost of creating a job 
of comparable educational val'ue in the private sector. 

4. An approximatiqn' pf equitable distribution between local, 
state and federal' sources. o!f the additional Posts of 
carrying out these fJrbgrams. 



Approximation of the relative effect on adult displace- 
ment of creating youth jobs in each category' 

• ' 

Supervisor and other job descriptions and competencies 
required for the . new roles called for in thes^ new pro- 
.§rams (e,.g. , in school sheltered income-producing pro-^ 
jects) , and descriptions, of programs of training and 
experience that will develop these competencies. 

Descriptive research on exemplary use of QETA' resources 
to provide vocational education fbr student^ who do not 
academically qualify, for admittance to regular vocational 
educational programs. 

' ■ ■ . ' 

Analysis, from the vocational education perspective, of' 
the studies of collaboration between CETA and state and 
Ideal educational agencies, 'includ4ng "the following: 
vocational education, Cooperative education, career edu- 
cation, the distributive education clubs, the Future 
Farmers of America, the Junior Achievement, etc. Studies 
snow underway by the National Association of State Boards 
of Education, the Council for Employment Pbllicy, the 
Bureau of Occupational and Adult Education and the^ Of f ice 
of Career Education of- the U.S. Office" of Education are 
examining these questions. Additional ^data collection 
is probably not needed, only analysis of these reports, 
from another perspective. ■ . ^ . 

Descriptive i^esearch on ways to" support with state and 
local funds those - altern-ative schools which* sJrve youth ^ 
who are not well. served by regular school programs. This 
assumes that such schools can a<:hieve agreed upon educa- 
tional objectives at costs that are comparable to the 
costs of the regular school or at costs clearly justified 
by the greater difficulty of helping these youths. This 
■ might involve " updating voucher research and the problems 
that alterijative schools pose for teacher and counselor 
bargaining organizations. " - 

Descriptive research on the optimu|ti trade7off between the 
benefits of targeting programs to low-income participants 
and the benefits of having a mix of participants with 
differing conventions', ahd patterns, of reasoning.- There 
are several studie's under way to provide data for the 
descriptive resear,ch or analyses recommended above and 
although some additional data may], be" needed, the analyses 
could begin with the dat^ now being collected. 



; NUMMARY , 

' Th0 research and analyses that should* b'6 undertaken should 
emphasize agreement on goa'ls for jo)D creation, lai^or force parti-, 
cipa^ion and employment for- youth, goals that will look to the 
eradication of the discrepancies between poor minority youth and ■ 
the middle* class majority. The goals will include the establish- 
'ment bf criteria for measuring the ability of an adolescent to - 
make a successful transition from schoor to -work. This measure 
of transitability will take into account basic skilds, work 
skills, maturity and standing. It also will permit the comparison 
of the effectiveness omvarious educational, training and employ-, 
ment programs ' in developing these skills. ' 

Agreement is needed on an approximate path model .showing the 
relationship between background, education, training, chance 
events, and wha,t one makes of lifd. From agreement on this model 
should come agreement on the desirable changes in programs of 
education, training and employment and the co^t of making these 
changes'. Agreement on these changes should lead to a determina- ' 
t.ion as to which organisations' ought to 'do what part of the job, 
what collaboration is fieeded, how money will- be 'raised and how 
it will flow. . . 



, . • ■• •'s^Rupert; Evans _ 

Professor of Vocational-Techni-cal' Education / 
^ University -Of Illinois 

Verif i'cation. Interview 
Voca'tional Education. Needs . and R &, D Priorities 
' -. * , August 23, 1978 • • 

, After Morrison provided a brief explanation of the purpose 
.of the interview, Evans explained some of the thifiKing beihind " 
the needs he had checked as highest priority for R&D. 

Coordination ^ To what degree does -vocational 'education serve 
as a vehicle for basic learntrfg? Vocational education ' of ten claims 
that it teache^ reading and computation skills to people with whom 
other education groups do not work very well. Evans would like to 
see this elainv examined, arid if >t is valid, to' see the circum- 
stances under which such teaching is most effecftive. 

Career D^elopmei^t . Evans opened the* discussion .of career 
development by referring- to th'e Phi Delta Kapp^n article by ^ 
Eggington on the attitudes of vocational students. Although Evans' 
was critical of this particular study, he thought it addressed an 
important topic. This topic could prol;)ably best be summarized as 
socialization for the workplace. Evans cited the work of several 
-revisionist .historians (Calahan, Feinberg, Violas) who have argued 
that vocational education is designed to- produce "docile wage 
slaves." Their argument, according to Evans, is that since World 
War I education has been primarily concerned with enhancing pro-* 
ductive efficiency and vocational education is p^rt'^^f thil general 
historical trend. The?e historians claim that when the capitalidts 
were .cut off from the cheap labor supply in Europe, they "turned to 
public education, particularly vocational education, to fill their 
labor need$. Vocational education was structured to produce gradu- 
ates who were willing to accept the discipline " of the Work place. ' 

, ■ . • 

Evans asked^, if this view of vocational education were to.be 
accepted,. what woul^ be its implications? Would not placement 
in related -occupations be higher "if the emphasis were truly' on 
producing docile workers? Hov^, do the occupational areas 
differ in the attitudes they develop in workers? Evans cited 
agriculture and office occupations as two areas that are likely 
to produce quite different kinds of attitudes. How would one 
deliberately design a program to prodi^ce a desired set of attitudes? 

^Bvans repotted that the most -controversial work he has ever 
done was to include among the objectives of vocational education 
"increasing the option^ available Xo students" and "using voca- 
tional education as^ a motivati^n'g force to. enhance all types of 
learning". Evans said he was surprised by the number of vocational 



educators who think the primary function of vocational education 
is to supply skilled workers for the needs of- society. These 
educators seem to feel that if young people gain' things of personal 
benefit that is fine, but that vocational education should not" 
spend its tiit^e trying to produce t^hese personal benefits. Evans 
thinks some research on the goals of vocatipnal education — what . 
they are what, and should be — would l^e useful . . ^ 

Personnel Development . Evans checked personnel developments 
^s.a need requiring research; he thinks\that, standards for voca- 
tional teachers have been "vastly lowereS.--" He would like to know 
how this change came about and what its effects have been. 

Research and Development . Evans described some of the pre- 
sent resear^Trhe~Ts~~con3uctIng on the outcomes of previous R & D- 
in Illinpis. He identified some projects that state-officials 
consider among their better products. Evans' is now trying to 
trace these projects to the point where they no longer had any 

no?SS^4-S« '^^^K^-?- Practices or to the point where those who were 
using .the technigues no lo^nger knew they were derived from research. 

^In another project Evans is tryinr to determine the compara- 
tive advantages of on-the-job and laboratory based instruction. 
VJhich is the better setting for accomplishing different types 
objectives? He is studying this problem with handicapped popula- 
tions in settings such as sheltered workshops and ..state -institu- 
tions. Evans noted that mentally hai)<^icapped students go through 
'a p^evocational program before part-time cooperative placeijient, 
yet this practiceM.s not conside*red necessary for the nonhandi- 
capped Who entfer part-time cooperative vocational programs. 

Morrison notM that the question 'of OJT \(ersus laboratory 
training is part of the general , question of the effective condi- 
tions of learning. Evans agreed and referred to the changes in 
the military- during- the 195,0 's from OJT t-o the laboratory; now 
the military appears to be going the other way.. OJT is an effec- 
tive way of dividing up and hiding the real costs of training. 
Since we are not in an active war, everyone in the military is. 
training now. 

Special Needs . Evans mentioned the relationship between 
socioeconomic st^gjs and vocational education. He said there/-/ 
is clear evidence that secondary vocational education students 
tend to be from the lower half of both the -SES and verbal ability 
distributions. Students who go on to two-year postsecondary train- 
ing tend to be low ^on one of the distributions apd high on the 
other. This happens with no other group. Evans wondered what 
the reasons for "this might be. - ' 
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Evans reported that many directors of vocational education in 
the lar^e' ci^ties do not want to.be involved with programs con- 
ducted under the Ybuth Employment and Demonstration Projects Act/ 
and asked who is conducting these programs?' Evans hears many 
vocational directors wishing for the good old days" when they 
selected. the best of their applicants for training^ . Lewis 
commented that during those good old days vocational education 
was frequently * referred to as a dumping groun^--.- Evans replied 
that this has always existed — elite programs tor the best students 
side -by* side with "dumping ground'^ programs, \ 

Returning to the problem of the handicapped, Evans said that 
there is evidence th^t the parents of handicapped children migrate 
to areag which have the best programs fc|r their children; One 
policy implication of such a finding is that programs for the 
handicapped should not be funded with locat Resources, that j3ro- 
viding for the handicapped is a broader responsibility. Evans 
also said that it is provi^^^dif f icult -to satisfy . accountants . 
when vocational education delivers services to special groups in 
mainstreamed glasses. It is far easier to satisfy accountants 
when we provide services 10 special classes./ Thus, Evans noted, 
decisions get made for bookkeeping reasons rather than educational < 
or social reasons^ 

Other Issues . In addition^ to the .needs which. he check'ed ak 
hi,ghest priority for R&D, Evans consented on a number of other 
issues facing vocational education.- 

• ^ . 

Evaluation . Evans feels vocational education needs something 
e<juivalen,t to the economist's concept of value add«d. Instead of 
jnerely looking at employment or any other output measure alone, 
assessment should include what a program has achieved with a stu- 
dent (difference between entry and exit behavior). Eli Ginzberg 
has sugges£>sd that a criterion of effectiveness be whether a 
training program produces 'an employable worker, not an employed 
' one. . . 

Demographic Trends . Evans asked what will' happen to voca- 
tional education when the. population in the secondary-postsecon- 
dary age range drops by one million per year? Experience in 
Germany and Japan suggests ^ that as a shortage of' young people r — ■ 
appears, the proportion of 'the ayailable population that emrolJ^s 
• in vocational educa±ion increases; 

■ * 

Labeling. Evans would like to" see some research on the 
effect .of labeling. He see's signs that federal support may be 
l\ma ted to aid for the handicapped and disa'dvantaged. If this 
. happened would vocational education be seen solely as a program • 
for the hard-to-employ? Would employers be willing to hire 
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or enter into cooperative progifims for vocational students? Evans 
referred to the cur^nt debate over whether CETA should be limited 
to the structurally unemployed* CETA sponsors want ID percent * 
who are not chrbnically unemployed to avoid the labeling of the 
whole prograih. 

•Another aspect of labeling concerns the value of mainstream- 
ing for handicapped studehts. Does placing -the handicapped in 

regular classes avoid labeling? 

t , ■ 

structure . Evans noted that there is considerable discussion 
of whether, vocational education should be offered at the/ secon- 
dary school level. If it were to be moved, what would be the 
effect on the, dropout rate? As the percentage of dropouts Con- 
tinues to increase, there is more reason for programs such as 
YEDPA. Most secondary school dropoi^ts occur at age 1^, before 
entry to vocational educatioai What would be the effect on the 
dropout rate \»f reittoving 'any chance for enrollment in secondary 
school vocational education? 



J 
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Charles Law / 

« 

. . Stat 3 Director, North Carolina 

Verification Interview ^ ' ' . ' ' 

Vocational Education Needs and R&D Priorities 

October '20, I9?8 • ^ 

After a brief discussion of the purpose of the infeerv,i|^by 
. Morrison, Law reviewed the five need "areas he had checked and 
explained his reasons for checking them. 

.V Curriculum Content and >Introduct ion . In Law's view nothing 
that a state dqea is as' important as its work in- instruction • " 
and 'the development 'of curriculum. To, Law an SEA is ^ teacher 
educaticsn instituti9n. Some of his colleagues sometimes ask 
Law about his enforcement responsibiMties . Law's ^eply is that 
he is an en force rV but what he enforces is the comoetenrv ptn- 
aents. it this is achieved, every other important rule is 
enforced. ^ ^ 

Law believes that' it ds onl^ through curriculum that a state 
has any re^l control.. In North Carolina they have devfeloped cur- 
riculum units that start with a set' of validated minimum compe- 
tencies in defined skill areas. From these, units of instruction 
^ and leai'ning activity packages are developed Validated test 
items are ,availab;.e to measure student' performance, and an indi- 
vidual competency testing record is provided for each student. ^ 
This r,ecord li^ts the validated competencies in the skill area 
and the, degree to'whi'ch a student has mastered these competencies. 
Coupled with these curriculum units are staff development activitie 
directed to teachers and administrators. , - ' ' 

" The kind of R & D that Law would like to see involves the 
transferability of vocational ^skills . He cited the principles 
of hydraulics which a student learns in phe study of autoiirative 
braking systems. He claimed these can be applied .in any job 
that involves the movement. of fluids in a closed system. /'Stu- 
dents know more than they know that they know," he said. 

Law thinks, there is a nefed for federal help in identifying 
areas of transferability. He afided that vocational education' needs 
to acknowledge that many skills are the same across different 
occupational areas. Law recognizes that there are some who" fear 
that bVemphasizing general skills vocational education will lose 
Its dist^ictiyeness, -but he ^oa^ not see this as' a real concern. 




Personnel>^eg^elopment . Once curriculum that emphasizes trans- 
ferabili«ty has been developed, it will be necessary to train 
teachers 'and administrators to use it. Law thinks that many, of 



our past efforts have "left teachers behind." There has been too 
much emphasis at pther levels and not enough attention paid to 
teachers. . ^ ' 

. Planning . Law would like pl.arming to emphasize "what , 
have, wheiire , and why . He thinks planning in vocational educa-^ 
tipn has been attempting td^ accomplish too much — planning, evalua- 
tion, and reportii^g. In response to a. -qiiestiort on supply of and 
demand foi: vocational students. Law says the data are not too 
good, but ^t is more* important to* him to know what students can 
do. ' * ^ 

Interaction with Employer's/Unions . Law de-emphasized uni'ons 
in his state because "we don't have a large number of unions. " - 
Relations' with employers *he considers very importa^nt. ,As unions 
grow, s6,will their involvement. * 

General Comments . Law yglunteered some general comments on 
past R&D emphases in vocational education. He thinks there has . 
been too much rese"arch on special need^ 'sex stereotyping and so 
on. Law feels the more we fragment^ the less we can deal with ^ . 
the whole enterprise.' As a state * director / he must deal with the 
whole of vocational education in hi5 state , not with bits and ^ ' 

pieces* ' " J ' ' . . y 

Lewis noted that our other panelists had tended to agree 
with Law/ but that our panel,, had quite different priorities 
than 'a panel NIE hro.ught together in 1976. Law said he was 
familiar with the NIE panel and when its members are compared to 
ours, the reasons for the differences are apparent. 

Law added that he ^elt the federal government is "in for a sur^^i 
prise" in the jcoming years. As the priprities of the states con- 
tinue to differ from those of the federal' government , many 
states will be writing their own vocational education legislation. 
Uorth Carolina, for example, passed its ovm legislation two 
years ago.. If the restrictions on the use of federal funds becone 
mdre and more strict/ the federal dollars will be used where they 
fit into the' state master plan. ' 

Law sees these developments as. a backlash against federal *" 
restrictions which have become s'tronger and stron<^r as the federal 
gove^rnroeht has tried to control what it perceives .to be unrespon- . 
sive states 4 Law added that he cannot get money from his state's 
general assembly for the kinds of things Washington wants to do « 
and "frankly I don't want to go over there and^ ask for it." 

' . - ' ■ , * 

V 



George Wallrodt 
Acting Executive Director (when interviewed) 
National Advisory Council on Vocational Educatibn 

Verification Interview 
Vocational Edudation Needs & R & D Priorities 
' August 22, 1978- 

Morrison opened the interview with a brief description of 
the. purposes of the study and noted that Wallrodt had crossed 
off three of the needs .on the list he' reviewed, when asked if 
these were general needs of vocational education, rtot just 
research needs, Wallrodt said he thought they were general needs, 
wallrodt had a number of coiranents regarding the specific needs 
which he checked off as most important for future R&D: 

Curriculum Content . Wallrodt was interested in new and emerg- 
ing occupations. He wohd^ed if these will require shifts in 
present programs or the creation of whole new programs. He asked 
how far ahead it is necessary to identify new and emerging occupa- 
-tions in order to plan, and develop programs. 

Wallrodt noted that the U.S. Department of Commence has been 
making efforts to track new and emerging occupations, providing 
the name of a Department of Commerce staff member who has been 
involved in this effort: 

Mr. Theodore Lettes • , . 

Room 5092, OMBE r . , 
U. S. Department of Comi^ce 
14th & Constitution Ave. 
Washington, D.C. 20230 
-Area Code 202 377-3165 

Coordination. Wal'lrodt feels it is essential that vocational 
education develop linkages with all- the training ^rogranvs outside 
of public education. He said the new CETA legislation will put 
far more stress on institutional training. He thouaht it would be 
useful to Identify models of Successful interaction between CETA 
and both vocational education and successful in-school ' youth pro- 
jects. Then, the elements that, underlie the successful interaction 
might be . determined. ^ . 

I. 

Later ' in ^the interview Wallrodt returned to this need and 
mentioned that CETA-vocational education coordinat^ion at tihe local 
level- vi?i 11 be forced by the federal government. At the national 
level he does not think coordination is too important; He men- 
tioned tliat the Department of Labor recently is^iied an RPP for 
Tier 1 projects to be funded in 16 cities. The proposals had to 



A-8 



. 202 



be submitted in cooperation with LEAs. Several hundred applica- 
■ tions were received, which meant that in each of these cities the 
C?:tA and vocational education people had to work together to pre- 
pare the proposals. Wallrodt also said that new CE^'A legislation ' 
will require a planning process based on the vocational education v 
model. The process must spell out how the" CET A* program is going, 
to use existing facilities, including vocational education facili- 
ties. • • ' ^ '. • . 

f • • ' ' ' ' • 

A coardinat ion-articulation question that Wallrodt considers 
high priority concerns' the proper roles for secondary and post- 
•secondar.y -level instruction. Wallrodt said it is not necessarily 
a secondary versus post-secondary question, but more a question 
of where the most effective training is taking place. Wallrodt 
posed some specific questions regarding articulation: How much 
duplication of training is there? Is it possible to make post- ' 
secoi>dary instruction the "graduate school" for secondary? Is 
there a need for four years of training in any area? Are there 
special post-secondary methods or techniques which are more effec- 
tive than secondary methods? I^ it basically just a question of 
what level gets the money? r * 

Another type of linkage Wallrodt ^mentioned is. with the Depart- 
. -ment of Defense training activities. This linkage has two . aspects .'■ 
One is to convert tXDD curriculum materials to civilian use, while • 
the second is to assist the ' transition of trained peqpld from the 
military to the private labor force. To achieve this second type 
of linkage it would be necessary to gear military training more 
• closely to civilian j^b requirements. . 

if' 

, , ^Vfj; Ration . Wallr^jfit cited the.heayy emphasis on evaluation 
in .the 1976 Amendments. He i-ef erred to the "ton of evaluations" 
coming in f3^o^ OE and NIE, and wondered how all these are going to' > 
be us^d. Wallrodt suggested that evaluation results be examined 
as they are avail^b^e, especially for improving programs rather 
than for just^ influencing legislation. 

Interaction with > Employers/Unions . It was Wallrodt ' i " opiniou 
that vocational education has done well at keeping in tou'ch with^ 
employers and unions,' but it could probably do better". He thought 
that cooperative education should b«/ expanded, suggesting a need 
assessment of cooperative educatioh in hew and expanding occupa- 
tional area's. Also, suggested was a syntfiesis of the available . 
evidence on how successful cooperative education has been. 
^Wallrodt has the impression that in comparison to in-school instruc- 
, tion, cooperative programs have greater relevancy, their students 
are more motivated with better work habits and so forth. 
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• ♦ Transition from School 
sions which he would like to 



to Work . Another of 
see tested concerns 



V^llrodt's impres- 
his. feeling that 
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vocational students ^eem to have an easief: time. mbving fropi school 
to work.- Is this true?; If it is, what are the factors that 
account for xp What are the diff erences ■ between the students ' 
who make the transition 'easily ' and those who jdo not? Here, too, 
^Wallrodt would- liWe "to., see .a synthesis -of the existing informa- • 
tion an^ research directed to the unanswered questipi>s. 

Wallrodt asked whether the relationship between training aod 
employment is an appropriate criterion of the effectiveness of 
vocational education. Are^fche 'students who enter and stay ' in 
related jobs necessarily blotter off than those who *e>^p'lore by ' 
moving from job to job? What are the value assumptions underly- 
ing 1;he judgment that stafe^mty is better? 

^ Because of the emphasis that lodal districts place on pre- ' 

p^mg students for local labor market needs, Wallrodt mentioned- 

"that former Congressman Pucinski has proposed a "Title i" for 
vocational education. The money supplied under such an act would 
be- used to i^rovide a broad cross-section, of training in skills 
that are not needed in particular local markets. Pucinski, justi- 
fies such training, by the high level of geographic mobility in 

• young people. ' ■ 
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' William Woo If" 
Former. Colorado State 'Director 
• ' , Verification Interview . ' 

Vocational Education Needs and R Prio'ritie,s ' 

. October 9, 1978 

.Morrison' began the discussion with a brief description of 
.the purpose of the study and -the names- of o^her individuals who 
ar6 serving ^on the verification panel. Lejwis then asked Woolf if, 
when he checked the needs which he considered most important 
to vocational education, was he indiciting overall needs or those" 
that are loost important for R&D. Woolf replied that he chose 
needs for R&D and gave a brief description ^ the way he 
• approaches problems. %e said he constantly loDks for a frame- 
work, an approach. He^ tries to take a long-range, macro view 
that is feasible, and his major oisjective is to keep students; 
dn tune witH the labor market. In this context he explained why 
he checked funding as an R.& D priority need. 

Funding . Woolf thinks- the methods that states use to allo- 
cate vocational education funds should be examined. He said there 
are probably three or four models used irt different states through 
out the nation. He suggested that' a study be launched to identify 
these various, models and to determine a rational, defensible liasis 
for fund distribution. "Project Baseline, said Wool,f> made an 
attempt to collect descriptions of how the states allocate funds 
but the results were totally inadequate. What is needed, in 
Woolf 's opinion, is analysi's and model building to determine 'the 
most worjcable methpds. Exampltea he cited were formulas bailed on 
PTE or ADA and excess costs. He ^asked' if it is possible to 
determine the relative merits of-'each method, and if it is, then " 
he felt a major objective should be to improve vocational educa- 
tion programming by improvin'g funding systems. 

Equipment and Facilities . Woolf thinks . jresearch is needed ^ 
equipment and 'facilities to eliminate the variation in local 
decision-making. In Woolf 's view the field needs objective 
standards of an acce'ptable program. These standards would cover 
such things as equipment, square footage of floor space, and 
safety factors. ' An acceptable program would have to meet these 
minimum standards, but an LEA would be free to exceed them. Woolf 
thinks it would not be too difficult to arrive at the standards. 
He thinks a panel of business/industry and educational consultants 
could develop them and verification could then be carried out. 
Once such standards* are available, they could bemused for accredi- 
tation and evaluation. Without such standards, LEAs can excuse 
poor performance of students in their vocational programs by 
saying th^y do not have the proper equipment. Leaving decisions 
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on. equipment and facilities iij the ha;ids of "the LEA is, in Woolf s. 
judgment, inviting the kind of criticism that the GAO report 
•■^oduced.* 

V ,\ ^ ' • 

Curriculum . Woolf feels vocatiorial educators, relatively 
speaking, nave the easiest. task in all of education because they* 
are training for piarticular finite joljs. He thinks there" would 
,be little argument on the basic skills that a're needed for differ- 
ent jobs. Once these are identified, these are what vocational 
education should teach. ■ 

While competency-ba.sed instruction does attempt to identify " 
and teach essential skills, Woolf claims that at the present time 
■most developmental- efforts are at th^ LEA level-^ ' He 'thinks they 
should be at the federal level to avoid cost inefficiencies and 
lack of standardization. He does not think this represents federal 
control. As with equipment and facilities, he sees the federal 
government assisting in the setting of minimum standards for pro- 
grams. ^ <- ' * 

Woolf believes the identification of skills ^o'be taught has 
to be a federal effort because there ^re too many: jobs being 
taught ia vocational education for any L^A or state to make the 
ef f ort^needed^^ t the curriculum consortia 

cannot keep up. Woolf feels Congress should be pj;:essed on these 
kinds of probleins. The }cinds of R&D cuj^ipaculuin approaches that 
aJTe presently being funded are, in his opinion/ uillikely to have 
any impact. ^ 

Data Collection and Evaluation . Woolf thinks the number one 
R ^ D priority — miles ahead of anything else--is better data on 
the supply of and demand •for skilled workers, especially supply 
information. There are many different kinds of training programs 
and little data on how many trained workers are being prepared. 
Woolf -feels it is critical for vocational education to stay in ^ 
tune with the demands of the labor market, because if it gets out 
of tune, it \^ill lose its categorical aid. 

' With, regard to evaluation, Woolf feels that Congress was ricjht 
on target with its requirements for evaluation, ^en though voca- . 
tional education is being asked to meet a higher standard than the 
rest of education; He said we cannot hold teachers responsible 
for things (in the labor market) they cannot control. Woolf thinks 
vocational education should focus on student achievement — that 
is, the. field should be able to demonstrate the contribution of 
vocational progrsuns by comparing the performance of students at 
the beginning and end pf their training* Besides, in. Woolf 's 
opinion, follow-up data quality is "atrocious" in 45 out of 50 
states. • Follow-up studies should be continued but the quality 
should be improved. 
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-Woolf had some fc>rief comment's ori thh following topics: 



Planning . Congress is right and the Bureau- is wrong. Thfe' ' 
Bureau through ifs Check sheets and plan approval system is 
requiring documents that are not triie plans. Wliat is needed is 
planning that is useful for management. 

Projected Manpower Demand and' Supp l y .- We need to know the 
demand for teachers and how this interfaces with demand and Sup- 
ply for skilled workers and program trainees. . - 

Role of Federal, State, and Local Governments in Go vernance 
and Operation ot Vocational Education. Everyone's expe'ctatT nns 
of what the other levels can and should do are unrealistic. There 
should be an analysis of who can do what best. 

. Political Strategies to Prot'ect and Promote Vocational 
Educati6^ woolf feels categorical aid must be. maintained. AVA 
has deteriorated in its political effectiveness and the Bureau 
IS simply not effective. The field needs leadership. It» does not- 
have many people who realize the importance of power politics. ( 
Thirty years ago there was a much stronger power base with its 
roots in the agricultural states and state directors with long . 
-tenure. Presently agriculture, in general, h^s'little political' 
power and there are few directors who have hel^^osition for 
several years. 
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